Local Git remotes

(cblgh.org)

70 points | by surprisetalk 7 hours ago

13 comments

  • zenoprax 5 hours ago
    I was expecting the use of non-SSH git remotes without network access. Any mounted file system can be a valid remote such as a USB drive. I use file-based remote to keep some repos encrypted on S3 using Rclone.

    For example, `git remote -v` would show: `secure-s3 /mnt/fuse/rclone/secure-s3/git/$REPO.git`

    I think concurrency is a problem with file-based remotes but for one person keeping a desktop and laptop in sync it is much simpler than running a VPS.

    • kmarc 4 hours ago
      I use Keybase's encrypted git repo the same way (to sync "private" dotfiles across laptops / remote workstations)
      • theptip 4 hours ago
        How is Keybase doing these days? I stopped following after the acquisition, but I like the concept.
    • nasretdinov 6 hours ago
      You can also have multiple independent git repos that don't duplicate the full object store, via git clone --reference. It's less relevant in the container era, but otherwise it can save a lot of time and disk space when cloning repos repeatedly
      • packetlost 4 hours ago
        Oh, that's actually really useful for my... inefficient clone of nixpkgs and the linux kernel...
      • mystifyingpoi 6 hours ago
        What's the purpose of this? I don't get it. Why push at all to "local remote", if you can just keep your changes on a local branch, and push it whenever "remote remote" becomes available again?
        • chrstphmr 3 minutes ago
          [delayed]
          • pokstad 6 hours ago
            I use this to push changes to a local encrypted sparse bundle image, and then I periodically rsync that image to a remote disk. Git has no built in encrypted storage, so pushing directly to a remote means you trust that remote.
            • tracker1 2 hours ago
              Depends on if/how you're communication and/or working with others... lets say github/devops/whatever is down... but you're still wanting to get work done and collaborating with other devs.

              Being able to target a shared SSH server in your control while the upstream service is down is pretty freeing... and even if you aren't releasing to production/test/etc, you can keep making shared progress.. even more important with trunk based development.

            • ok123456 4 hours ago
              I use local remotes all the time for testing as a form of "local CI".

              Check it out from '/tmp' and make sure it still builds.

              For a single-dev or small team, it beats having to do github runner epicycles to accomplish the same basic goal. Add in Firejail if you want environment isolation.

              • mook 2 hours ago
                Would git worktrees be useful in that use case? It just adds a new checkout in a different directory without duplicating the git data (blob storage).
                • gcarvalho 3 hours ago
                  I do the same sometimes, but a one-off clone is not quite the same as maintaining a "local remote" and pushing refs to it.
                  • ok123456 33 minutes ago
                    If it fails, you fix the clone and push it back.
                • adregan 6 hours ago
                  A decade ago I was working with an intern who wasn’t allowed access to push to any branch. As I wanted him to get experience with the development cycle, I set up a bare repo in a shared Dropbox folder and had him push code there.

                  Aside from that unique use case, I might consider this for storing code on a network attached drive (archival).

                  • tonypapousek 5 hours ago
                    I reckon most folks have made a git oopsie and needed to re-clone a repo at least once in their career.

                    Having a “local remote” would be an awfully quick way to do that, especially in situations with no/low network connection or a flakey upstream server.

                    • bregma 5 hours ago
                      > I reckon most folks have made a git oopsie and needed to re-clone a repo at least once in their career.

                      And I recon this is the default workflow for most people most of the time.

                    • newsoftheday 3 hours ago
                      For my selfhosting, I use local remotes the same as if I were using Github or Gitlab, as part of my CI tools chain, using a git hook script to kick off the Jenkins build on the remote directory. Everything is backed up daily and monthly (separately).
                      • pglevy 3 hours ago
                        I recently did a similar thing to get all my private repos off GitHub while keeping the same git workflows and accessibility for other machines on my home network. Now my Pi is the remote for those repos.
                        • m463 5 hours ago
                          I've used it to quickly start a git project, with source control, no credentials to deal with, etc

                          eventually I can set up a proper git repo, set up credentials, etc.

                          I think it's like how some people use 127.0.0.1 for stuff, then later expand the software engineering process to do it right.

                          • adastra22 5 hours ago
                            I don’t understand. A proper git repo is… your git repo. Git is distributed.

                            I have lots of projects under for version control with no remotes.

                            • mystifyingpoi 1 hour ago
                              I can imagine it being useful for some obscure setup of local CI (like Jenkins) that expects a Git URL and for whatever reason cannot just copy files from one directory to another. Or maybe Argo/Flux tinkering to mimic real repo. But nothing usual should require such tricks.
                              • adastra22 45 minutes ago
                                There is no such thing as a git url. It is just a URI parser for the endpoint, which could be local filesystem, NFS, SSH, etc. Being able to HTTP fetch is/was an afterthought.
                              • leephillips 2 hours ago
                                Yeah, I don’t get it either. The command is `git init` and you’re done.
                            • ulrikrasmussen 6 hours ago
                              I am also seriously puzzled and don't see the point. Why push to a local remote if the real remote is not reachable? The branch is still not leaving your machine, you are just making a copy of it in another place and now have to manage `local/` refs in addition to `origin/`.
                              • weaksauce 4 hours ago
                                It's useful for me to have a "production" website remote that i just run on my computer for myself locally. rsync could also work but tagging with rollbacks make it easier if something goes wrong. it's not a common thing but it's nice to have that as an option. just because you can't see the utility of it doesn't make it useless
                                • ulrikrasmussen 4 hours ago
                                  True, but TFA did not actually present any use cases.
                                • fwip 5 hours ago
                                  "local" can also be a network fileshare. It could also be in a directory that is treated differently than your other checkouts - whether that's something like deployment, sharing over the web, running CI, etc.
                                  • mystifyingpoi 1 hour ago
                                    "network fileshare" is not local. By the same logic, I can mount S3 bucket over fuse and call it "local". Sure, it will work, but in the context it is just nonsense.
                                    • ulrikrasmussen 4 hours ago
                                      I doubt it is safe to concurrently modify a git repo over a fileshare though. I don't understand the other use cases you mention
                                  • XorNot 5 hours ago
                                    Within certain bounds git behaves quite nicely with a directory of bare git repos and Syncthing.
                                    • dist-epoch 5 hours ago
                                      I use this to work with multiple agents in multiple sandboxes - they push to the local remote instead of GitHub which is now unreliable.

                                      And I push to GitHub/GitLab from a repo outside the sandboxes.

                                    • joeyguerra 4 hours ago
                                      I love reading articles like this. It's kinda of a slap in the face – "hey guys, you know that thing you've been doing for decades, well for decades you've had this ability to do it with your own stuff if you just spend a few human brain tokens on it".

                                      btw, Git also supports the HTTP protocol ...

                                      • jjice 4 hours ago
                                        While yeah it's a thing that many people already are familiar with, I don't think it hurts to push out these concepts once and a while to help spread info to recalibrate those who hadn't learned these yet. I'd rather we have a bunch of articles explaining git specifics than a bunch of engineers that don't know the difference between git and GitHub.
                                        • chriswarbo 2 hours ago
                                          > btw, Git also supports the HTTP protocol ...

                                          In fact, Git supports any protocol! If you add a git remote like

                                              git remote add my-remote my-super-duper-protocol::some-sort-of-address-thingy
                                          
                                          Then pushing/pulling `my-remote` will try to invoke a command called `git-remote-my-super-duper-protocol`, with `some-sort-of-address-thingy` in its arguments. You can implement that however you like.

                                          I use remotes like "pkipfs::y5a9inx61aski4miz4sgmg55qgbazxhfwab3i6ee1ypa6rnumi8o", which invokes a custom git-remote-pkipfs command that pushes/pulls object data to IPFS and resolves/updates refs as subdomains of a specified pkarr address.

                                        • barnabee 3 hours ago
                                          I do this to a ~/git-sync/<project>.git directory that's synced over Syncthing for all my personal projects it's great.
                                          • antiframe 6 hours ago
                                            GitHub has been such a staple of the modern dev that some are now (re)discovering git is distributed.
                                            • alsobrsp 6 hours ago
                                              Everything old is new again. I wouldn't be surprised if there were people that thought GitHub invented git.
                                              • elevation 5 hours ago
                                                > thought GitHub invented git

                                                Putting the generic term into your corporation's name can be effective means of claiming things that don't belong to you.

                                                Jon Postel reserved 44.0.0.0/8 for a generic purpose: "amateur radio digital communications." Decades later, there was a successful heist when some enterprising individuals who had incorporated "Amateur Radio Digital Communications" misrepresented to ARIN that the assignment had actually been theirs. Immediately after ARIN gave them transfer rights, they pocketed 8 figures reselling the space to Amazon.

                                                Github obviously isn't making explicit claims like this but they benefit whenever people with purchasing power implicitly understand that github is the only option.

                                                edited: Amateur Radio Digital Communications is not an LLC

                                              • orev 6 hours ago
                                                That assumption has come up in almost every conversation I’ve ever had with semi-technical people regarding git, so the confusion is just a fact. It happens so often, I think Linus (or whoever controlled the git trademarks at the time) should have demanded GitHub change their name when it was launched.
                                                • enoint 6 hours ago
                                                  More precisely, a movement to leave GitHub mistakenly endeavors to leave git.
                                                  • jjice 4 hours ago
                                                    I know so many people I went to school with and have worked with that _still_ couldn't tell you the difference between git and GitHub.
                                                    • tardedmeme 4 hours ago
                                                      I don't think I've ever met a programmer online who didn't think git and github were the same thing.
                                                      • wanzg 5 hours ago
                                                        One of my younger colleagues indeed displayed a mistaken impression of that kind last week.
                                                    • ucirello 5 hours ago
                                                      That's what I used to do with git (just recently moved off of SVN) in a shared computer predating github. It works very well!
                                                      • cerved 6 hours ago
                                                        you can also setup a local remote which hardlinks the index so it doesn't occupy more space. Why? Idk. You don't want to share stash, rerere-cache, branches whatever.

                                                        Also handy if you're running an agent in a container on the local fs. Set up a local clone, contain the agent to that repo folder and have it hack away on that. Later, you step out of the container and do the syncing. You can't use worktrees in this situations.

                                                        Bare repos are also pretty cool. You can clone the git mailing list as a bare repo and search for threads there instead of setting up an mbox (same for the kernel obviously)

                                                      • whax 4 hours ago
                                                        Interesting that the footer of the page contains the magic string Anthropic provides to trigger model refusal (styled small and clear).
                                                        • enoint 6 hours ago
                                                          It’s hard to sincerely bring up things like site-to-site VPN, without condescending.
                                                          • cowmix 2 hours ago
                                                            [dead]
                                                            • thehwang 5 hours ago
                                                              [flagged]
                                                              • globular-toast 6 hours ago
                                                                A "local remote" is a contradiction. Unless the remote is on a different disk you are just wasting space. Even then the point of remotes is for sharing, not for backup/redundancy.
                                                                • Zambyte 6 hours ago
                                                                  The remote can be a shared directory that multiple users have access to, and the working directory is private where each user only has private read + write access.
                                                                  • orev 6 hours ago
                                                                    What if you have a few local machines you’re using for development, and want to keep them in sync? This method allows that single central repo without having to bounce all the code through a cloud hosting service.
                                                                    • globular-toast 5 hours ago
                                                                      OK, different meanings of word "local". TFA uses "local" to mean the same machine, not the same local network.
                                                                    • cowmix 2 hours ago
                                                                      I use them ALL THE TIME. If anything, I have my 'local remote' in my Syncthing shared dir - its great for sharing code between my dev workstation(s) w/o using Github, etc.