How to use Phison aiDAPTIV+

Phison-aiDAPTIV-plus.png

 

# Install LVM

sudo apt update

sudo apt install lvm2 xfsprogs

lshw -class disk -class storage | grep -E 'ai100|logical name|version: EIFZ'

 

lsblk | grep nvme

 

# Dangerous！！！ Need to make sure number is right！！！

sudo wipefs -a /dev/nvme0n1 /dev/nvme1n1

 

# Create LVM

sudo pvcreate /dev/nvme0n1 /dev/nvme1n1

sudo vgcreate ai /dev/nvme0n1 /dev/nvme1n1

sudo lvcreate --type striped -i 2 -I 128k -l 100%FREE -n ai ai

 

 

# Mount LVM

# Format the disk.

sudo mkfs.xfs -f -s size=4k -m crc=0 /dev/ai/ai -f

 

# Mount the disk.

sudo mkdir -p /mnt/nvme0

sudo mount /dev/ai/ai /mnt/nvme0

sudo chown -R $USER:$USER /mnt/nvme0

 

 

# Make mount persistent

sudo echo '/dev/ai/ai /mnt/nvme0 xfs defaults,nofail 0 0' | sudo tee -a /etc/fstab

 

# Remove permanent mount setting #sudo sed -i '//dev/ai/ai/d' /etc/fstab

 

 

# Check disk status

lsblk

 

# If you need to dissolve LVM Setting

# sudo umount /mnt/nvme0;sudo lvremove -y ai;sudo pvremove -y /dev/ nvme1n1 /dev/nvme2n1 -- force --force

 

# If you only have one SSD, please follow the steps below to mount

#sudo mkfs -t ext4 /dev/nvme1n1

#sudo mkdir -p /mnt/nvme0

#sudo mount /dev/nvme1n1 /mnt/nvme0

#sudo chown -R $USER:$USER /mnt/nvme0

 

cd

 

sudo mkdir -p /data/llm_train

 

sudo chown -R $USER:$USER /data

 

cd /data/llm_train

 

wget https://d.leaderg.com/aidaptiv/train-Llama-3.1-8B-Instruct.7z

 

7z x train-Llama-3.1-8B-Instruct.7z

cd /data/llm_train/train-Llama-3.1-8B-Instruct/model

 

 

# Hugging Face

# read token hf_xxxxx

 

# Install python environment 

pip install -U "huggingface_hub[cli]"

 

huggingface-cli download --token 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 --resume-download meta-llama/Llama-3.1-8B-Instruct --local-dir-use-symlinks False --local-dir Llama-3.1-8B-Instruct

 

 

mkdir -p /data/llm_train/aidaptiv

 

cd /data/llm_train/aidaptiv

 

wget https://phisonbucket.s3.ap-northeast-1.amazonaws.com/aiDAPTIV_vNXUN_2_01_00.tar.gz

 

sudo docker load < aiDAPTIV_vNXUN_2_01_00.tar.gz

 

sudo docker image list

 

 

sudo docker run --gpus all -it --ipc=host --privileged=true --ulimit memlock=-1 --ulimit stack=67108864 -v /data/llm_train/train-Llama-3.1-8B-Instruct:/app -v /mnt/nvme0:/mnt -v /dev/mapper:/dev/mapper aidaptiv:vNXUN_2_01_00

 

 

cd /app

 

cd commands

 

bash example.sh

 

 

# List all docker containers

sudo docker ps -a

 

# Remove docker container

sudo docker stop <CONTAINER ID>

 

# Remove docker container

sudo docker rm <CONTAINER ID>

 

 

 

 

 

 

 

 

Contact Us and How to Buy


Welcome to contact us. Please refer to the following link:

https://www.myai168.com/article/index?sn=11059

Thanks for our customers

Taiwan University, Tsing Hua University, Yang Ming Chiao Tung University, Cheng Kung University, Taipei Medical University, Taipei University of Nursing and Health Sciences, National Chung Hsing University, Chi Nan University, Ilan University, United University, Defence University, Military Academy, Naval Academy, Feng Chia University, Chang Gung University, I-Shou University, Shih Chien University, Taiwan University of Science and Technology, Taichung University of Science and Technology, Yunlin University of Science and Technology, Chin-Yi University of Science, Formosa University, Pintung University of Science and Technology, Kaohsiung University of Science and Technology, Chaoyang University of Technology, Ming Chi University of Technology, Southern Taiwan University of Science and Technology, China University of Technology, Gushan Senior High School, Taipei Veterans General Hospital, Chang Gung Medical Foundation, Tzu Chi Medical Foundation, E-Da Hospital, Industry Technology Research Institute, Institute for Information Industry, Chung-Shan Institute of Science and Technology, Armaments Bureau, Ministry of Justice Investigation Bureau, Institute of Nuclear Energy Research, Endemic Species Research Institute, Institute of Labor, Occupational Safety And Health, Metal Industries Research & Development Centre, Taiwan Instrument Research Institute, Automotive Research & Testing Center, Taiwan Water Corporation, Taiwan Semiconductor Manufacturing Co., Ltd., United Microelectronics Corp., Nanya Technology, Winbond Electronics Corp., Xintec Inc., Arima Lasers Corporation, AU Optronics Corporation, Innolux Corporation, HannStar Display Corporation, Formosa Plastics Group., Formosa Technologies Corporation, Nan Ya Plastics Corp., Formosa Chemicals & Fibre Corporation, Chinese Petroleum Corporation, Logitech, ELAN Microelectronics Corp., Lextar Electronics Corporation, Darfon Electronics Corp., WPG Holdings, Mirle Automation Corporation, Symtek Automation Asia Co., Ltd, ChipMOS Technologies Inc., Dynapack International Technology Corporation, Primax Electronics Ltd., Feng Hsin Steel, China Ecotek, Grade Upon Technology Corp., AAEON Technology Inc., Stark Technology, Inc., Horng Terng Automation Co., Ltd., Zhen Ding Technology Holding Ltd, Boardtek Electronics Corporation, MiTAC International Corporation, Allion Labs, Inc., Sound Land Corp., Hong Hu Tech, etc.