Study Notes

Implement-HiVT-with-Latest-pytorch-and-pl-Version

2025-02-28T07:11:57.000Z

# Implement(deploy) HiVT with latest pytorch&pytorch-lightning version

refer to https://blog.csdn.net/kddb1234/article/details/136831258, https://github.com/pyg-team/pytorch_geometric/issues/4358 and https://github.com/gzerveas/mvts_transformer/issues/68
the official env of HiVT is pytorch 1.8, python 3.8, pytorch-geometric 1.7.2, pytorch-lightning 1.5.2 and cuda 11.1, which versions are too early. So, this blog will deploy HiVT with higher version of torch&pl with python 3.10, pytorch 2.1.0, pytorch-lightning 2.0.3, PyG 2.3.1 and cuda 12.1.

# Preparation

conda create -n HiVT python=3.10
conda activate HiVT
conda install pytorch==2.1.0 cudatoolkit=12.1 -c pytorch -c conda -forge
conda install pytorch-geometric==2.3.1 -c rusty1s -c conda-forge
conda install pytorch-lightning==2.0.3 -c conda-forge

# Modification of hivt src

# train.py

the “gpus” in parser should be changed to “devices”

the ArgoverseV1DataModule has no from_argoverse_args function any more, it can be input directly like:

similarly to the datamodule, pl.Trainer should also be fixed

# ade.py and other metrics

the compute_on_step parameter is no need, just delete it from the input parameter of init function

same applies to other py files in the metrics directory

# local_encoder.py

the new version of nn.Transformer add a parameter is_causal so it should be added in the TemporalEncoder class, which employs nn.TransformerEncoder as transformer_encoder variable

# Modification of PyG code

find the collate.py in the directory .conda/envs/${your env name}/lib/python3.10/site-pacakages/torch_geometric/data/collate.py. Then find the get_incs function and delete the input variable ‘store’ of data.inc()

1 2	cd .conda/envs/${your env name}/lib/python3.10/site-pacakages/torch_geometric/data gedit collate.py

# Others

If you encounter problems about variables, add ‘**kwargs’ in forward() function may be help

# Now you can try to train HiVT follow the official doc

official doc: https://github.com/ZikangZhou/HiVT

Hello World

2024-11-06T08:54:04.531Z

Welcome to Hexo! This is your very first post. Check documentation for more info. If you get any problems when using Hexo, you can find the answer in troubleshooting or you can ask me on GitHub.

# Quick Start

# Create a new post

1	$ hexo new "My New Post"

More info: Writing

# Run server

1	$ hexo server

More info: Server

# Generate static files

1	$ hexo generate

More info: Generating

# Deploy to remote sites

1	$ hexo deploy

More info: Deployment

Deploy My Own Blog

2024-11-06T05:39:36.000Z

# Deploy my own blog with hexo(theme: Shoka) and github

# Prepare

a github account
install Git(get ssh working) and Nodejs on your PC or Mac

# Hexo

install
sudo npm install -g hexo-cli
without sudo may encounter permission issues result in install fail
init your blog folder
hexo init blog
cd blog

install some dependencies
sudo npm install
sudo npm install hexo-deployer-git --save
get writing root for blog file
sudo chmod -R 777 blog
preview your blog
hexo s
visit http://localhost:4000/ you will see your blog page
(optional) download a theme from https://hexo.io/themes/ and move the file to /blog/themes
the Shoka theme is here https://github.com/amehime/hexo-theme-shoka

# Github pages

create a repository namely username.github.io
modify the deploy section in /root/_config.yml

deploy:
  type: git
  repo: https://github.com/username/username.github.io.git
  branch: main

after coding your blog, you can deploy it
hexo g
hexo d
visit http://username.github.io then you will see your blog

# Create a new blog

hexo new "new blog name"
put the picture in file with the same name of the new blog

note: the title should not include special symbol such as ‘&’

# Back up the source code in another branch of the repo

refer to https://blog.51cto.com/u_14233037/5824524

enter the .deploy_git(hidden file) folder
cd .deploy_git
create a branch called src
sudo git branch src
then copy the .git(also hidden) file to the blog path(parent directory)
associate the path to the repo
sudo git remote add origin https://github.com/username/username.github.io.git
run the command you will see the repo info
sudo git remote show origin
添加保存改动

1 2	sudo git add . sudo git commit -m "source code updata"

change to the src branch
sudo git checkout src
pull your local source code to the repo
sudo git push origin src:src
every time update following commands are needed

sudo git add .
sudo git commit -m "xxx"
sudo git checkout src
sudo git push origin src:src

Remote Control with RustDesk

2024-11-05T14:43:46.000Z

# Remote Control with rustdesk and zerotier(Macbook as control end, ubuntu as controlled end, raspberrypi4B as relay server)

# Preface

macbook: m1 pro
raspberry pi 4B with 4G ram and Ubuntu 20
linux PC with ubuntu 20.04
课题组的服务器在 1 楼，工位在 4 楼，因此需要远程。todesk 和向日葵免费版的都很糊而且 todesk 免费时长有限又需要经常登陆微信，不好用。

# Prepare

# Control end

download rustdesk for mac: 官网 https://rustdesk.com/，选择 macos arm64 下载
download zerotier(make sure that ssh is working)
curl -s https://install.zerotier.com | sudo bash

# Controlled end

与控制端同理

# Relay server

download zerotier as before
download rustdesk-server(Note that it’s not rustdesk, it’s rustdesk-server, i.e. the rustdesk server) in here https://github.com/rustdesk/rustdesk-server/releases, download hbbs-arm64 and hbbr-arm64(raspberry pi is arm architecture) then unzip
pm2 is used to manage process hbbs and hbbr, so nodejs and npm are needed
- install nodejs
  $ sudo apt install nodejs
- install npm
  $ sudo apt install npm
  $ npm install -g n
- install pm2
  $ npm install pm2 -g
  $ pm2 completion install
- check process list
  $ pm2 ls

enter the directory hbbs and hbbr and run them respectively
$ cd /Rustdesk/rustdesk-server-hbbs_1.1.11-1_arm64/data/usr/bin
$ pm2 start hbbs
$ cd /Rustdesk/rustdesk-server-hbbr_1.1.11-1_arm64/data/usr/bin
$ pm2 start hbbr
copy the key in the file with pub suffix in the hbbs folder and it will be used later
Open these ports on the firewall:
- TCP(21115, 21116, 21117, 21118, 21119)
- UDP(21116)

# Zerotier

Register a zerotier account(https://www.zerotier.com/) and create a network. Join the network in all three devices. Log in to the zerotier official website, enter the network, tick these devices, and authorize them. Get the IP address of these 3 devices

# Let’s Go

In both of control end and controlled end, 点击 ID 旁边的三个点选择 Network，然后解锁，ID server 和 Relay server 均填入 relay server 的内网 IP，api server 不填，key 中填入此前保存的 hbbs key。Control end 中输入 controlled end 的 ID 即可连接。

# Some Problems

these may work
https://github.com/rustdesk/rustdesk/issues/440#issue-1191020225