Welcome to the gccrs-workspace, an ARM64 Docker-based environment for the gccrs designed to be used with ARM MacOS!
This is created to standardize the development process for Mac-based devs on gccrs.
PRECAUTION: Only ARM-based Mac devices should be cloning and using this since the docker image that this is based on is configured for ARMv64.
Docker is a cross-platform tool for managing containers.
First, you will have to download and install Docker to your machine so you can access the Workspace. This can be done in one of following two ways.
- (Preferred) Download the Docker Desktop app from the Docker website.
- (or) download both the Docker Engine and Docker Compose
jjasmine only built an ARM version to work with with MacOS, please don't use this if you are not ARM-based, virtualization cross-platform are heavy on resources.
-
Clone this GitHub Repository via https
git clone https://github.com/badumbatish/gccrs-workspace.git
-
Navigate to the Repository
cd gccrs-workspace
-
Run Docker Compose for the first time
docker-compose up
This command will build and start the Docker container defined in the
docker-compose.yml
file. If needed, you can change the port used for SSH within this file.The first time you run
docker-compose up
, something like this should happen[+] Running 10/12 gccrs-workspace [⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿] 679.8MB / 684.1MB Pulling 40.9s ✔ f4bb4e8dca02 Pull complete 1.2s ✔ b34c89ba2949 Pull complete 0.9s ✔ 61d8855b6961 Pull complete 3.8s ✔ b0e8950b3326 Download complete 37.0s ✔ 7a2dfbe0ca39 Download complete 2.4s ✔ 705d5ce2ef7a Download complete 3.3s ⠹ 4f4fb700ef54 Downloading [==================================================>] 32B/32B 39.3s ✔ 26eaf58bb146 Download complete 4.7s ✔ e6a4a2a7b1b9 Download complete 5.0s ✔ d5ba4437dd44 Download complete 5.6s ✔ fe30df8d0cd6 Download complete
Wait until you see "Docker workspace is ready!" in the terminal. The Workspace is now ready (obviously 🙄).
Use Ctrl + C to stop the command.
Example output via
fish
shell:[+] Running 0/0 ⠋ Container gccrs-workspace-gccrs-workspace-1 Recreated 0.0s Attaching to gccrs-workspace-1 gccrs-workspace-1 | * Starting OpenBSD Secure Shell server sshd [ OK ] gccrs-workspace-1 | Docker workspace is ready! gccrs-workspace-1 | Entry directory is / gccrs-workspace-1 | CD-ing into /home gccrs-workspace-1 | Current directory is /home gccrs-workspace-1 | Downloading .clang-format... gccrs-workspace-1 | Downloading .vimrc... gccrs-workspace-1 | Downloaded all quality of life script gccrs-workspace-1 | gccrs-workspace is ready gccrs-workspace-1 | Currently at /home with directory structure: gccrs-workspace-1 | . gccrs-workspace-1 | |-- initialize.py gccrs-workspace-1 | `-- workspace gccrs-workspace-1 | gccrs-workspace-1 | 1 directory, 1 file gccrs-workspace-1 | Your ~workspace~ is ready
-
Starting the container in the background
docker-compose up -d
This will simply start the container in the background and keep it running. With Docker Desktop, you can also manage this through the GUI.
-
SSH into the Container
ssh [email protected] -p 2200 -o "PasswordAuthentication yes"
Use the password
workspace
the first time you SSH into the container.Example output via
fish
shell:jjsm@MacBook-Air ~/D/c/gccrs-workspace (main)> ssh [email protected] -p 2200 -o "PasswordAuthentication yes" The authenticity of host '[127.0.0.1]:2200 ([127.0.0.1]:2200)' can't be established. ED25519 key fingerprint is SHA256:LSt4ID5MGVhlh5qaIaI5OuG3GjTers4nI7B/0ywQAEg. This key is not known by any other names. Are you sure you want to continue connecting (yes/no/[fingerprint])? yes Warning: Permanently added '[127.0.0.1]:2200' (ED25519) to the list of known hosts. [email protected]'s password: Welcome to Ubuntu 22.04.4 LTS (GNU/Linux 6.6.16-linuxkit aarch64) * Documentation: https://help.ubuntu.com * Management: https://landscape.canonical.com * Support: https://ubuntu.com/pro workspace@9c72bba2b0d5:~$
-
Stop the container
Within your host machine's shell (not the Workspace shell you ssh'd into):
docker-compose down
Example output with
fish
shell:jjsm@MacBook-Air ~/D/c/gccrs-workspace (main) [127]> docker compose down [+] Running 2/1 ✔ Container gccrs-workspace-gccrs-workspace-1 Removed 10.1s ✔ Network gccrs-workspace_default Removed 0.1s
This will stop the container. Your data should still be saved within the hidden
.workspace
folder, so you can restart the container as needed and pick up where you left off.Note: To be safe, always push work you want to keep to Github!
Use with caution: If you ever need it, you can use
sudo rm -rf .workspace
to reset the Workspace. This will erase your cloned fork and any ssh keys necessary to push your work to GitHub.
To avoid entering the password every time you SSH into the container, follow these additional steps from your host machine:
Having fired up your environment with docker-compose up -d
-
Copy Your SSH Key
ssh-copy-id -o "PasswordAuthentication yes" -p 2200 -i ~/.ssh/id_ed25519.pub [email protected]
Replace
~/.ssh/id_ed25519.pub
with the path to your SSH public key. -
Update SSH Config To alias the full SSH command, add the following lines to your
~/.ssh/config
file:Host gccrs-wp HostName 127.0.0.1 Port 2200 User workspace IdentityFile ~/.ssh/id_ed25519
You can now enjoy a passwordless SSH experience for your gccrs workspace:
ssh gccrs-wp
Happy coding!
On going work. Jasmine's going to work. Ork Ork Ork~~~
This section describes different steps prior and after of cloning your fork.
-
Setting up ssh keys
Please create a new ssh key in the workspace in this generating a new ssh-key article in order for git to recognize your ownership of your fork.
Alternatively, to not create a new ssh key, you can follow these steps to copy your ssh key to
.workspace
in order for git to recognize your ownership of your fork.-
In your original MacOS terminal (not the docker container), run
pbcopy < ~/.ssh/id_ed25519
to copy your ssh key into your copy-paste board. -
In your docker environment terminal, run
vim ~/.ssh/id_ed25519
and paste your ssh-key into that file, type:wq
to close the file via vim -
In the same docker environment terminal, run
chmod 600 ~/.ssh/id_ed25519
so that only you can read and write, this helps keep ssh quiet on errorPermissions 0xxx for '/home/workspace/.ssh/id_ed25519' are too open.
You can now clone your fork with this newly copy-pasted ssh key.
-
-
Cloning your fork
After this, you can clone your fork down in
~
now.cd ~ git clone `your fork .git here` gccrs # Clone your fork and rename your cloned folder to gccrs cd gccrs # change directory into your fork
-
Setting up remote (RECOMMENDED, OPTIONAL) After cloning, run this in your forked repo to set an upstream remote
git remote add upstream https://github.com/Rust-GCC/gccrs.git
-
Setting up customization of git (RECOMMENDED, OPTIONAL) In your forked and cloned repo, run
./contrib/gcc-git-customization.sh
More in-depth documentation (might be outdated) is at gcc-git-write.
In short, it asks for:
- Your name - git uses this when you commit messages. You can set this globally, but the script will confirm the setting is appropriate for GCC as well. If you have not already set this then git will try to find your name from your account.
- Your email address - similar to above. If this is not set globally, the script will not attempt to guess this field, so you must provide a suitable answer.
- The local name for the upstream repository - normally, the default (origin) will be correct.
- Your account name on gcc.gnu.org: (Not sure of the usefulness here, just press enter to continue)
- The prefix to use for your personal branches - the default is me, but you can change this if you prefer. (Not sure of the usefulness here, just press enter to continue).
- Whether you want to install prepare-commit-msg git hook for 'git commit-mklog' alias - You really should do this to avoid being overwhelmed by the work flow of gccrs in general.
Example output via
fish
shell during git customizationworkspace@1a7cad37dc38 ~/gccrs (master)> ./contrib/gcc-git-customization.sh Your name [(no default)]? jjasmine Your email address (for git commits) [(no_default)]? ############### Local name for upstream repository [origin]? Account name on gcc.gnu.org (for your personal branches area) [workspace]? Local branch prefix for personal branches you want to share (local branches starting <prefix>/ can be pushed directly to your personal area on the gcc server) [me]? Install prepare-commit-msg git hook for 'git commit-mklog' alias [yes]? yes Setting up tracking for personal namespace workspace in remotes/users/me
After setting up the repo via every step, you should be able to see something similar to this:
Example output via
fish
shell:workspace@e9318ff46f10 ~/gccrs (master)> git remote -v origin [email protected]:badumbatish/gccrs.git (fetch) origin [email protected]:badumbatish/gccrs.git (push) upstream https://github.com/Rust-GCC/gccrs.git (fetch) upstream https://github.com/Rust-GCC/gccrs.git (push) users/me [email protected]:badumbatish/gccrs.git (fetch) users/me [email protected]:badumbatish/gccrs.git (push)
-
You're done!
Congrats on setting up your work space for gccrs, now, please refer back to the Linux section of gccrs to continue build and test all the test cases before development.
Alternative if you have followed all the steps from 1 to 4 and am currently in gccrs, run this code to start building the code base by default. All the dependencies should have been installed for you.
Change from
make -j2
to a higher core count to build faster.mkdir ../gccrs-build && cd ../gccrs-build && ../gccrs/configure --prefix=$HOME/gccrs-install --disable-bootstrap --enable-multilib --enable-languages=rust && make -j2 # Change to -jX to use X core to build.
Then run the tests:
make check-rust
-
Speeding up (RECOMMENDED, OPTIONAL)
Please see speeding_up.md to speed up your workflow
Initially every version of the image should be sufficient for developing gccrs. New updates will only bring quality of life updates if MacOS-based maintainers of gccrs suggest so if not stated otherwise.
You should only do this if you'd want to have new quality of life that fits you.
You may need to update the image if changes are pushed. You could completely reset your workspace by deleting the .workspace directory. However, we provide a mechanism to safely update by tracking changes with git.
-
To be extra safe, push anything you want to keep to Github first.
-
Pull the latest image from Docker hub with
docker image pull jjasmine/gccrs-workspace
. -
Stop and remove the old container. You can do this through the Docker desktop GUI or the command line via
docker stop CONTAINER_ID && docker rm CONTAINER_ID
. You can find yourCONTAINER_ID
throughdocker ps -a
. -
Run
docker-compose run -i gccrs-workspace
and follow the instructions to update. You can exit out of the shell withexit
once it's done. -
You're done updating! You can go back to the usual way of starting the container.
-
Local build:
Simply run
docker build .
-
For maintainer:
If you would like to deploy changes to Docker Hub, first sign in with the
jjasmine
account and run the following buildx command:docker buildx build --platform linux/arm64 -t jjasmine/gccrs-workspace:vx.y --push .
where x, y are integersSomething like this should be displayed:
[+] Building 159.7s (22/23) docker:desktop-linux => pushing jjasmine/gccrs-workspace with docker 158.9s => => pushing layer b34e060e7f68 6.2s => => pushing layer a0d20f2d597d 5.0s => => pushing layer 25b7309d5bdb 5.1s => => pushing layer 5f70bf18a086 158.5s => => pushing layer 30d28f08fbad 4.3s => => pushing layer 22cb36038158 10.7s => => pushing layer 902f74f878ca 11.0s => => pushing layer 706723e7a464 156.98MB / 1.07GB 158.5s => => pushing layer e1327057188d 108.13MB / 181.12MB 158.5s => => pushing layer 2b967fea2034 120.12MB / 723.98MB 158.5s => => pushing layer 0c6ee22ab34f 109.58MB / 149.92MB 158.5s => => pushing layer 718cff4cb42c 100.02MB / 185.59MB 158.5s => => pushing layer e765fc14f7f3 158.5s => => pushing layer 0e53a3b142a5 158.5s => => pushing layer bfa656ccdc47 158.5s => => pushing layer 842bef16b8fb 158.5s
-
WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED error on ssh
It is possible that you've registered port 2200 (the default port of gccrs-workspace) with another host. There are two methods to resolve this.
-
Run
vim ~/.ssh/known_hosts
or your favorite editor on the file and search for[127.0.0.1]:2200
and delete those lines to reset them. -
Another method you can do is to use a different port via
docker-compose.yml
settings where the line involved ports are highlighted
version: "3.9" services: gccrs-workspace: image: jjasmine/gccrs-workspace tty: true volumes: - ./.workspace:/home/workspace ports: - "2200:22" <---- CHANGE YOUR PORT FROM 2200:22 TO xxxx:22
-
-
git operations are taking a long time. What is going on?
Please refer to
Speeding up git
subsection in the gccrs-cloning section
-
Vscode's C++ analysis server is taking a very long time to scan, what is going on?
gccrs is a big repo, hence it will take a long time to scan every file. I suggest only open vscode in
gccrs/gcc/rust
to limit the processing requirements of vscode. -
Vscode's C++ analysis is not working.
You might want to run
chmod +x /home/workspace/.vscode-server/extensions/ms-vscode.cpptools-1.19.9-linux-arm64/bin/cpptools
and roll back theC/C++ Extension Pack
tov1.2.0
.This error has been reported to occur on
v1.3.0
of the extension.
-
configure: error: no usable dependency style found .libs yes checking for strstr...'
make[1]: [Makefile:3092: configure-build-libcpp] Error 1 Try sudo with your command when you run
make ...
ormake check-rust ...
This repository was originally forked from CS162 and thus benefitted heavily from the infrastructure that was set up by CS162 course staff.
Contributors including (but not excluding):
- https://github.com/ShreyasKallingal
- https://github.com/PotatoParser
- https://github.com/jel221
I decided to break fork since I think the repo has deviated from the original structure of course staff.