Self-hosting isn't just about tech choices — it's about *who controls access to knowledge*.
During the Enlightenment, owning a physical copy of a book meant intellectual freedom. You didn’t rent ideas; you had them. Today, most digital knowledge is hosted, locked, or streamed — *leased from platforms*, not owned. We’re in fact drifting into *digital feudalism*, where access to culture, tools, and even history depends on gatekeepers.
In a perfect world this should go beyond market logic. It’s not just a question of what's sustainable or profitable. It's about *civic autonomy*. If the infrastructure of knowledge is centralized, then so is control over thought.
Self-hosting may not be for everyone, but *distributed, open systems are essential* to preserving a democratic and durable digital commons.
I personally prefer owning my content, physical books, and having local copies.
But if I’m being honest, I think this claim that if you don’t own the book you don’t have the knowledge and society will turn into digital feudalism is hyperbole. Knowledge is proliferating faster than ever, becoming more accessible than ever, and it’s easier than ever before to get the info that you’re searching for, even in this streaming world. The idea that I’m going to lose knowledge from a book I read 5 years ago if it disappears from my library just doesn’t track. In fact, it’s rare that I return to my physical books these days because I can find equivalent info faster from a quick search online.
Don’t get me wrong: I prefer having my own copies and so on. However, when people start throwing around concepts like “digital feudalism” and trying to draw parallels to the enlightenment it feels like this is all some abstract philosophical debate rather than a discussion of what’s really happening in the world.
> Knowledge is proliferating faster than ever, becoming more accessible than ever, and it’s easier than ever before to get the info that you’re searching for
Information is proliferating and is more accessible, but a huge amount of that information is lies and manipulation I'm not sure that really counts as knowledge.
> The idea that I’m going to lose knowledge from a book I read 5 years ago if it disappears from my library just doesn’t track.
You might not forget what you learned from a book you read 5 years ago after it gets stolen from you, but it does mean that others are cut off from that same information. Worse is that what you saw 5 years ago might still be made avilable, but only in censored/altered forms which could easily have you questioning your memory of something you read or saw just 5 years ago.
It's not just an abstract philosophical debate that books and other forms of media are being changed, censored, or removed entirely. Or that gatekeepers want to decide what we're allowed to see and extract rent from us every time that we do. The dangers are real and understood and very much present in today's world.
> Information is proliferating and is more accessible, but a huge amount of that information is lies and manipulation I'm not sure that really counts as knowledge.
I don't think that's any different to any other period of time when communication was suddenly able to expand. Gutenberg's press didn't come with an automatic lie detector that meant the printed word could only contain true facts and nothing else. Instead, it was mainly used for pamphlets and other campaigning propaganda - some of which surely had some truth to it, but much of which was partially or fully fabricated.
I think you are romanticising the past's approach to the written word here. It has always been possible to completely rewrite history, if you're willing to put the work in, and totalitarian regimes have had no issues in convincing their populations to burn their own books if necessary.
it has never been easier to poison the well of knowledge at the scale possible today. the internet enabled instantaneous dissemination whatever version of reality tickles your fancy. the effort required is also minimal.
The same was true of the printing press, though, at least in comparison to the communication of the previous era. It enabled lies and propaganda to be spread far quicker than ever before, and by people of every rank in society, with (comparatively) minimal effort. And yet, despite this, we think of Gutenberg's invention as one of the most important tools of the modern era for bringing about societal change and enabling people to speak the truth.
Is there something materially different here with the internet? Are we now entering an era of too much free speech? Is it now too easy for us to communicate with each other? And if so, what's the cutoff? What arbitrary barrier would we need to put in place to make the internet more like the printing press and safe to use again?
> Is there something materially different here with the internet?
Yes. There are effectively no hard copies. It is possible to change the historical record of any non-printed material to suit your particular needs like never before.
You can think of this as a world beyond Orwell's or Bradbury's wildest nightmares.
On the other hand, it is now easier than ever to make copies of materials that we see. Famously, the internet never forgets, and even the smallest mistakes or slip-ups are retained in perpetuity, as long as someone is interested enough in keeping hold of the original copies. And there are a lot of organisations that are very interested in keeping hold of original copies.
I would argue that the opposite is true: it is now harder than ever to change the historical record, which is why we now talk about hypernormality and post-truth, where even if there is evidence for something, people will still lie and claim the opposite and be believed. We live with an abundance of evidence, and yet the Orwellian ability for people in charge to tell you one thing one day, and another thing the next, has never been stronger.
And I think you're again making the mistake of thinking of the printing press as a device for printing books or other materials designed to be long-lasting and valuable. In practice, the printing press brought about a revolution of flyers and pamphlets - ephemeral documents that were distributed one day and then abandoned the next. These things should change freely, and many never entered the historical record at all.
> On the other hand, it is now easier than ever to make copies of materials that we see.
Is it? I feel it's the other way around. For example, just 10 years ago, there were no apps that forbid me from taking screenshots. Copying CDs and DVDs was comparably easy, even for normal folks. How do I copy a Netflix episode again?
I meant "now" in that sentence to refer to the internet era in general, in comparison with other technological leaps. But still, these protections are usually very limited, and fairly easy to circumvent. Most people I know might not be able to convince their laptop to let them screenshot Netflix, but they do normally know how to find pirated copies of the TV show they want to watch. Paying for the convenience of Netflix might still be worth it for them, but the ability to step beyond that should that convenience disappear is definitely there.
I agree with that first sentence, but I think the trend matters more than the average over a few decades.
Also, you said "On the other hand, it is now easier than ever to make copies of materials that we see." - now you seem to be talking about finding a copy. But those are two very different things.
This is why I think archive sites will be attacked by the powers that would like information to disappear when they want it to.
Perhaps they'll use a warped interpretation of copyright law to do it, or maybe something even more draconian like censorship laws with a punishment for publishing banned information.
Could they do it, technically? Not unless they controlled the entire world's networks, including those of countries with competing aims. Would that stop them from trying? As we've seen with the endless attacks on end to end encryption, I'm sure they'd give it a shot.
I don't think it's possible, though. Or at least, I think it's harder now than ever before. The internet isn't completely decentralised, but it's at least spread out enough that it's seriously difficult to shut down any one part of it, at least without being willing to take some serious authoritarian measures. Look at how difficult it's been for the most influential media companies in the world to fight piracy, for example.
I genuinely think our society is one of the most censorship-resistant societies in history. This comes with its own problems (how do you deal with media that genuinely is harmful, like calls to violence or plots to abuse children?) but I think this is the tradeoff that one has to make when dealing with censorship and liberty. The more you make it difficult for the authorities to shut down good speech, the more difficult it becomes to protect against harmful speech.
I'd like to think I'm not. In the past, at least there was an original "hard copy" - and any regime wanting to rewrite history would have to meticulously either eradicate any prints, or - as happened in the Eastern Bloc - they would have to physically rewrite history. Pages from books were lifted out, edited to suit the needs of the narrative, and then meticulously put back.
With online-only records any hard copies will be incidental. The source-of-truth for any record has always been online, and can be retroactively edited with much less fanfare. Incidentally, it will also be much easier to flood the world with the updated narrative.
Hell, we have Musk publicly advocating to edit old online material to suit the new, "more desirable" narrative.
The material difference with the Internet is ROI. If you're going to attack your enemies, the ROI of a troll farm is thousands of times higher than that of a standing army and a conventional military campaign. The ROI of an AI-powered automated troll farm is even higher.
The result is a kind of anti-literacy. Most people can read the words, comparatively few people are media-literate enough to filter truth from lies with any reliability. So the current media landscape is unusually poisonous. It's mostly vested interests lying to you and trying to manipulate you, through ads, troll farms, and mainstream media.
The fix would be AI filtering of content. Right now there's no chance whatsoever of that working accurately, but it's possible in principle to counteract the rise of AI disinformation with AI critiques of it.
Among all of the other revolutionary changes promised by AI, that possibility has flown under the radar. But it would be a political and economic showstopper if implemented, because everyone would suddenly be seeing authoritative, accurate news and analysis - like old-school fairness doctrine journalism, but better because it could presented at a level that matched the reader, while also allowing questions.
Ironically Grok was doing something like this for a while, until it... wasn't any more.
Everyone says this… but everyone also complains about access to eyeballs. Posting is cheap, getting people to see it is not cheap or easy, and getting harder.
Pretty sure there were plenty of things read during the enligtenment that was not 100% true. Do you really think everything in books back then was true?
> But if I’m being honest, I think this claim that if you don’t own the book you don’t have the knowledge and society will turn into digital feudalism is hyperbole.
I dunno, when Roald Dahl e-books auto-updated to censored versions with no way to rollback it did feel distinctly dystopian.
If you think beyond kids, when a certain book is ruled illegal in a certain country it will disappear from internet-connected devices overnight. Seizing physical copies from people's homes is orders of magnitude harder.
> Knowledge is proliferating faster than ever, becoming more accessible than ever, and it’s easier than ever before to get the info that you’re searching for, even in this streaming world. The idea that I’m going to lose knowledge from a book I read 5 years ago if it disappears from my library just doesn’t track. In fact, it’s rare that I return to my physical books these days because I can find equivalent info faster from a quick search online.
The real problem with this is that there are vested interests at play in managing what information you see first - push something to the 2nd or 3rd page of google results and it becomes effectively invisible, especially when you have pages and pages of results that seem to push the narrative that those vested interests want you to see.
I tend to think that Huxley was right over Orwell, information is lost in the shuffle of distraction and rigged systems. The "truth" is there to find, but it's a needle in a haystack of believable lies, and those lies were crafted specifically to obfuscate that nugget of truth.
So the amount of information moving around is irrelevant if it's not useful, or it's intentionally misleading from something that might upset those who benefit from the status quo.
I would have agreed with you a few years ago. But now Google, DuckDuckGo etc. at most provide 3 pages of results, with many irrelevant or wrong. There are alternatives:
I think when people say "digital feudalism", they usually mean that the spaces where we do things digitally are increasingly owned by private entities that operate them for their own benefit. It's an analogy which can't be expected to align perfectly with historical feudalism.
Steam library not so much, most likely they will have to re-buy the games because even if they inherit or I just leave credentials and 2FA I can imagine someone there in business thinking "hey this account is 100 years old, we should clean that up, unless guy sends us birth certificate and proof he is still alive.".
As one example, if the Internet Archive goes offline, a massive corpus of the last two decades is gone forever. As another, I had a friend who bought hundreds of dollars of PlaysForSure music only to have the store shut down and the license revoked within the span of 12 months. Hope you didn’t care too much about those 3DS, Wii and Wii-U eshop games. (And on and on.)
We currently live in a world of abundance and access. Even with that, there are movies that can no longer be seen, music that can’t be listened to, and books that can’t be read because they were never widely or publicly available.
> Knowledge is proliferating faster than ever, becoming more accessible than ever […]
Thanks to Anna’s Archive and similar sources, but that doesn’t contradict the general trend toward “feudalism” (not generally having permanent unrestricted access to the source of information).
> it feels like this is all some abstract philosophical debate rather than a discussion of what’s really happening in the world.
To judge what's happening in the world, you need a framework. And the frameworks provided by the ubiquitous commercial and political interests are all biased in comparable ways. Abstract philosophical debate is just what the doctor ordered to get you away from the incessant assault of propaganda and brain washing.
Knowledge is not proliferating faster than ever. It's being gobbled up and locked down by companies whose sole interest is making as much money as they can instead of improving the world and profiting from the improvement.
Media is being deleted or locked in vaults.
Games are being shut down with no way to restore them.
The written word that has been vetted by people with domain specific knowledge is being locked behind paywalls and not being advertised, while AI machines directly lie to the curious and the seekers of knowledge.
I can throw a digital stone in any direction and hit something that is worse off thanks to the modern internet.
At least 3 of your last 4 comments are purely GPT-generated, which isn't great for discussion here. I feel sorry for the 37 others who took the time to genuinely respond.
Agree, this is annoying, these comments shouldn't get elevated in the threads and moderators must flag these accounts. We can all use LLM's on our own people posting that output here is worthless and just pollutes this website.
The blog post talks about our self-hosting movies, photos, and podcasts, in nice Netflix-like interfaces. Sharing photos. That sort of thing.
You are talking about preserving intellectual independence.
Both are nice to have, but they are sort of different problems, right? Yours seems more important. And yours could probably be solved by a local copy of Wikipedia and an FTP server full of digital textbooks.
IMO one dangerous misstep we can make with self-hosting is to assume we need to start by matching the centralized services look-and-feel and polish (which is getting worse every year anyway).
> one dangerous misstep we can make with self-hosting is to assume we need to start by matching the centralized services look-and-feel and polish
That's an interesting take. I think matching these services isn't a necessity, but getting a polished look-and-feels just helps adoption. Adoption isn't an exclusive scenario and everyone is free to choose and mix how they see fit.
My private collection won't ever compete with Netflix, Google or the like, and that's completely fine. It will stay a private selection of media with a strong personal preference - it ranges from research to entertainment, and also includes stuff that documents my own individual history. It'll shrink and grow as I want it, and if it reaches a scale that makes the jump from archival to hoarding work I'd simply need to reconsider my preferences.
Here's my take: The scaling issues of these tech giants won't ever reach my personal archive and any challenges with re-indexing, data analysis etc. should be completely approachable on SOTA hardware. Running anything that improves the searchability of my own archive can be run locally and in the timely intervals I prefer. To have this kinda quality approachable is a huge thing, and I can't wait until I can self-host some RAG enhanced vector search engine for a personal archive that grew overs years to take shape.
> My private collection won't ever compete with Netflix, Google or the like
You are not allowed to do that!
The reality is that with minimal effort and money you can cheaply buy some multi TB drives. Get a 100 euro computer, a 50ish internet connection, a torrent feed and a usenet sub. Netflix has very little stuff by comparison.
You can also set up a crawler with some archiving and crawl that part of the internet that is interesting to you specifically. Feed it the urls you've visited, crawl 1-3 links deep from there and you will be in awe how fantastic the search results are. If you type "banana" in the search box it will give you a surreal page full of interesting pages about bananas. (Interesting to you only)
As the collection grows and time expires you will also be increasingly shocked how many of those website are not around anymore.
I ran a dead link checker on 10k old bookmarks for a niche topic one time. I didn't pay much attention to the topic for 8 years or so. I was very excited thinking I would find all kinds of new developments. In stead it was depressing as f. Something like 50 links worked. Stuff like a link to a Google search result.
I'm not sure. It seems like the harder they squeeze, the less they can hold onto. Books, movies, TV shows, audiobooks, music - you can find it all online for free and acquire it pretty safely (torrents/vpn etc). I think the only thing they can really sell us is convenience - and I buy it! But if that convenience is lost to fragmentation, or lack of offline availability (e.g., books), or price, I think people will stop paying and do the more convenient thing. There's a tension there that I don't think they can ignore.
Beware of believing everything is available over torrents: They’re probably hosting, waiting for every library to dwindle, so one day they will close the tap. There are already very few websites that index torrents. It’s a classing monopoly-then-disappear, Google-Reader-then-no-RSS situation.
> During the Enlightenment, owning a physical copy of a book meant intellectual freedom. You didn’t rent ideas; you had them. Today, most digital knowledge is hosted, locked, or streamed — leased from platforms, not owned. We’re in fact drifting into digital feudalism, where access to culture, tools, and even history depends on gatekeepers.
I get your broad point, but I would argue that for the vast majority of time most people did "rent ideas". Most people didn't have massive private libraries of books. Knowledge was locked in public or private institutions where if you were granted access by the owners of that institution, you would be allowed to go there and read the knowledge. If it was a public library you might even be able to take that knowledge home with you temporarily. But you wouldn't be able to keep anything you couldn't keep in your head, or transcribe yourself into your own documents. If the library closed, burned down, or you lost access to the institution, you also lost access to the knowledge contained within.
Which seems like then the argument should be for systems that allow you to take advantage of the ease and relative cheapness of copying and archiving digital forms of knowledge. To that end, "Print to PDF" being built into the operating system on mac OS might be one of my most favorite features. I have more than a handful of archived information from pages that don't exist anymore because of it.
This is AI slop. @dang this degrades this forum more than any flame wars. I can't stand people that outsource their entire thought process to an AI then post it like we can't use the tool ourselves. It adds nothing to the conversation.
Even though it may be AI-generated, it clearly received a lot of upvotes, including from me, because it said exactly what I wanted to say. Why is AI a problem? You didn't explain how exactly it degrades the forum or adds nothing to the discussion.
There's no value to this website if we're talking to LLM's, we can do that on our own. I want to come here to engage directly with other actual people and their brains. Not as an interface to ChatGPT.
That's not something to be proud of that you upvoted it.
It's not a discussion, unless you think talking to an LLM is a discussion or equivalent to HN.
And obviously if this is permitted or rewarded with upvotes it's just going to become an endless spam site of people posting low effort cotton candy they didn't need any thought to produce. No signal all noise
>There's no value to this website if we're talking to LLM's we can do that on our own
There's at least one value to LLM content: it always outputs correct grammar and punctuation. Unlike this human sentence of yours, which took me two attempts to parse because it's missing a necessary clause separator.
But on the substance of your comment, I (generally) agree.
Self hosting reminds me of the world of smartphones just before the advent of the iPhone.
Using a phone as a mini computer was possible. Downloading and using apps happened. I even used offline maps. It was still the preserve of nerds while regular people "couldn't understand why you'd use a phone to do anything other than text and call".
SUDDENLY once it became seamless and trivial to set everything and it was all brought together on a device that was aesthetically pleasing and ergonomic demand rocketed upwards. It turns out that regular people very much wanted a mini computer in their pocket.
This all took me very much by surprise coz almost everything that was revolutionary about the iPhone... I was already doing all of that while it was announced.
I think self hosting is in a similar spot right now. The apps exist (many are extremely nice!), the software exists, but the seamless, aesthetically pleasing and ergonomic experience does not. It's a pain in the ass to set up self hosting.
I remember there was this short period of time around (lousy approximate timeframe) Snow Leopard where a confluence of features and hardware was suddenly available and which would have made this just within reach of Apple completely changing the game:
- There were OOTB features on Mac OS X such as web page building and publishing
- There was Mac OS X, but there was also Mac OS X Server, a full-fledged, easy(-ish) to use solution to self host mail, calendaring, and so on
- There was Bonjour a.k.a Zeroconf, not just on the LAN but global as well.
- There was Back to my Mac and most importantly the technology underneath it which was essentially a "one switch Tailscale". Combined with the above you could SSH to any of your Macs from any other Mac you were logged into wherever it might be, Back to my Mac was merely VNC'ing/SMB'ing over that private overlay network.
- There was the quite budget friendly Mac Mini
- also, Airport Express/Extreme/Time Capsule, if you had one of those BtmM would magically WoL sleeping Macs.
- The Mac App Store was introduced
- Affordable residential FTTH started rolling out widely with solid downlinks+uplinks
And around that time I was god honest thinking: "these are all pieces of the same puzzle... next step they might turn each of their server features into separate server apps, and bootstrap an app store out of it for third parties to create and publish their own server apps, and everyone and their dog could have their own server of anything at home"
Instead things were dialled up to 11 towards datacenters.
Basically a Mac Server would have fixed 99% of our needs. Apple could make a Local iCloud Server / iOS Time Capsule where I still have all the content, but would require a subscription just for the backup services. And Apple could charge 3x the Amazon Cold Storage pricing just for reselling it.
I do think this is within realm of possibility if Steve Jobs is still alive. Or at least could be convinced.
Tim Coo only cares about services revenue. And iCloud it is.
SheevaPlugs [0] circa 2009 were perhaps a better promise of the age of self-hosting.
The most important bit here is solid uplinks, though, not OSes or boxen. At least in the US, self-hosting was choked off by cable-tv-based ISPs who offered asymmetric bandwidth with highly restrictive upload speeds. Partly that was because cable technology was originally designed to distribute media from the culture industry to the consumer, not peer-to-peer; partly that was an artificial restriction designed to thwart piracy.
The world today would look very different if every home in the early 2000s had been equipped with equal upload/download bandwidth; small home servers might have been normalized.
A second problem, and one that macOS server would not have solved, was collusion by the email big hosts (Google, Outlook, etc) to impose in the name of fighting spam restrictions that keep individuals from hosting their own mailservers. ISPs, of course, helped there too by blocking ports. Locking most consumers in to centrally-hosted email servers was a surveillance state's dream come true. If you can't send emails without suitable DKIM reputation, and only the big players get to determine whether you're reputable, you can't self-host your e-mail, and that's a major blow to privacy.
I, for one, miss my early internet days of having an AIX box with all services on it. I could telnet (SSH nowadays) in from anywhere and read my mail, newsgroups, etc., and update my web page and work on whatever. It would be awesome to have that ability again but with a server in my own home.
> This all took me very much by surprise coz almost everything that was revolutionary about the iPhone... I was already doing all of that while it was announced.
I remember my friends and my tech fiend cousin sneering at the iPhone when it was launched for this reason. I got heckled for “overpaying” for an inferior product when they learned I bought an iPhone.
Yet my actual phone computing experience was mostly better than theirs with a few notable lags (copy and paste). They had a different idea of what the iPhone was like than my actual experience and they refused to believe anything else.
It was like they lived in a world where your phone choice was your identity. They saw themselves as being at the top of the phone ecosystem and having made the right choice. They simply would not allow any other phone to be good because it was an attack on the narrative at the core of their identity.
At the time I just didn’t care. My iPhone worked well and I wasn’t interested in endless playing with all the customizations and changes they were doing on their phones. It got the job done and I liked how it worked.
I think self hosting is similar: The people drawn to it think their setup is the pinnacle of computing, but many of them have been so out of the loop on modern cloud services that they’ve forgotten what it’s like to use a cloud service that works well. They’re stuck believing it’s all useless eye candy on an inferior product.
I even see the same thing when I use Mastodon. The whole federation thing is a massive drag. Having to do the dance to follow someone on a different server gets old. I miss being able to one click follow someone and not have to pay attention to what site I’m on. Yet bring it up to fediverse fans and many will scoff at the idea that it’s a hassle at all. They might argue it’s a small price to pay. So many refuse to admit that it’s not a good experience. Situations like this run deep in every self-hosted or distributed project I’ve seen. They cater to people who enjoy fiddling with projects and debugging things.
It doesn't have to be difficult to self-host. Like another commenter said, in a diffe world that could be the default. iCloud gives apps an API to sync. The backend doesn't have to be a data center, it could be a time capsule in your living room. You could connect using a private wireguard lan. The protocol could even be built out to support redundant time capsules in case one failed.
But my parents wouldn't want to pay $500 for the hardware, and companies don't want to give up the monthly fees.
Yeah, at one point in writing this article I had a brief aside about more "off-the-shelf", accessible solutions to self-hosting like Synology. But I cut it because I honestly don't think they make the process that much easier. They help with hardware, but the software setup I think is still pretty difficult. Thanks for reading!
My impression as a high-schooler (at the time) of what made the iPhone so captivating for others, was that it had Shazam, and all of the features of the iPod touch, and all of the features of iPods before the touch. You could hold your phone up anywhere and learn what song was playing, and as far as I could tell that was basically it; very much a fashion thing like Starbucks (before the unjustified popularity of that also died as they stagnated). I thought people were a bit silly for spending so much on a phone then, and still do, because by the time I eventually got a "smartphone" with a touchscreen, there was enough competition in the market that still to this day I've never felt compelled by any phone product >$600
Not only were there Shazam apps on phones pre the first iPhone, but in the first place Shazam was a service you didn't even need a smartphone for! When I first started using it, they had a telephone number (in the UK, I'm not sure which other countries) to call up while music is playing, and 30 seconds or so later it would text you the song that it detected during the call.
I agree that "combining phone with one of the most popular / best in some ways mp3 player on the market" was a big part of it (with web browsing and video playing equally important), but Shazam wasn't a new thing that iPhones brought us.
(I also agree with danieldk that Shazam just wasn't a significant factor for most people on any devices, before or after iPhones.)
I had the iPod Touch and iPhone relatively early (well, much earlier than the general population). I don't remember Shazam being important at all, I think I only discovered it a few years later.
What blew pretty much everyone away that I showed it is how incredibly smooth web browsing was (remember, there were no apps on the original iPhone and even after that it took a little while for apps to really take off). Most smartphones at the time had clunky resistive touch screens or even little joysticks to move a mouse pointer. With the iPhone, you could scroll with your fingers and it was butter-smooth (at least for the day). The iPhone was a game-changer because you had a device in your pocket that you could browse the web with and it was at least as easy as on a desktop, if not easier.
Just for comparison, this is how you browsed the web at the time on probably the most iconic smartphone at the time (Blackberry):
Ok it may be just as painful and non-mainstream to self host these days as the pre-iphone or pre-blackberry smartphones were, and i can imagine that it could get easier in the future, but still what's the point of selfhosting for regular people when the cloud exists? Having a calendar, email/chat apps, webbrowser, maps+gps and everything else in your pocket was a major convenience improvement, but i don't see a benefit like that from self hosting. I only see better privacy, more control and ownership over your data, and in some cases lower cost (but often higher), and those aren't nearly as powerful motivators for people.
I could imagine self hosting becoming more accessible but don't see how it could become mainstream when it's just an alternative to stuff that's already available in the cloud
privacy and control are things which people dont tend to think about until:
* online apps start doing something incredibly creepy (all of my non tech friends have a story like "how tf did they know me and my wife were talking about crustacean sex?").
* some service people use shuts down, stranding their data.
* some service like gmail locks them out for no reason at all, stranding their data and blocking them off from the world (has happened to enough people to make others worried).
* some service gets hacked and leaks a bunch of data.
* some service jacks up prices to unreasonable levels (i predict that we will get more of this as the VC hose runs dry and tech consolidation increases).
* they get tripped up by some dark patterns.
Furthermore, I think the extent to which people would like to have things like smart AI that can see all of their personal data or video cameras in their house but dont pull the trigger because theyre worried about privacy is understated.
And, the rich and famous are of course even more concerned about privacy and where they go others follow.
>just an alternative to stuff that's already available in the cloud
This was my attitude to the iPhone in 2007 - it was just an alternative to stuff you could do on your laptop and other smartphones. It turns out that if you make it look sexy and make it ergonomic and give people a feeling of power and control they will shower you with money.
>>just an alternative to stuff that's already available in the cloud
>This was my attitude to the iPhone in 2007 - it was just an alternative to stuff you could do on your laptop and other smartphones. It turns out that if you make it look sexy and make it ergonomic and give people a feeling of power and control they will shower you with money.
Ya but it turned out that smartphones ended up being super convenient once they got good/usable enough, and it unlocked really useful things that you couldn't do before, or just made things more convenient. If I have all my gmail data at home (or on a machine I control in a data center somewhere), does that make anything more convenient for me? Whereas being able to navigate around a new city with zero knowledge of it, translate food packaging when I'm grocery shopping in a foreign country, communicate with with any of people from wherever I am as long as I have my phone on me - those are real benefits.
I do kind of like how you're thinking about this because I'd love to live in a world where I could have ownership over all my emails, social media data, music, etc and have it all be just as convenient (or more convenient than) and work just as well as gmail, instagram, spotify etc do today. But we've definitely been moving in the opposite direction for the last 20+ years and there's good reasons for that:
1. It's easier to have someone else (like google, facebook etc) manage something for you then manage it yourself. And in many cases when there's network effects it's impossible for you to replace the experience you get from one of these services on your own.
2. Most of the time, people aren't gonna do hard things like making good software (and solving the hard problems, not just the fun problems) or building a social network without some way of making money from it (either you paying for a service or them monetizing your data via ads or selling it)
3. It's way easier for them to manage everything if the data is on machines that they control than on your machine, and it way easier for them to get people to pay for a service (and deny them access if they don't pay) if its on their machines too
All that said I'd love to see the iphone of self-hosting someday
Pre-iphone I had my MythTV server recording and transcoding TV shows and then adding them to an RSS feed that my flip-phone would sync whenever plugged in. Unplug my phone in the morning and watch last night's Daily Show on the bus ride to work. Kind of crazy to think of what we could do even back then
This still exists... OsmAnd, offline map app for Android, has 10M+ downloads. Maps.me has 50M+ downloads. Sure, that's not 10B+ of Google Maps users, but still a lot of users.
I don't think the "advanced users" market has shrunk much, it's just the whole pie became so much bigger that the overall ratio decreased.
I think there is an effort being made for this. Some folks have created https://selfprivacy.org/ and continuously developing it. I follow this project by heart
I don’t think that’s a gotcha. Using a cloud provider in a way that provides easy migration options can be valid on the spectrum of self-hosting options. The ones they list specialize in renting virts by the hour/day/month, not lock-in services with no external equivalent.
- Battery life. One of the main reasons your phone lasts as long as it does is because it severely restricts the ability to run always-on things. A phone of course can run an email server, but the battery life will immediately tank to the point where the device becomes largely unusable for its original purpose.
- Phones make extremely poor servers because connectivity is intermittent. This is fine for software that's 100% local, but a lot of the most useful software needs to talk to the internet - or more importantly, has to allow the internet to talk to it. Imagine losing an email because you walked into the subway and your phone was unreachable the moment an SMTP server tried to connect to it.
> Battery life
Would it be any more battery life consuming than having an always on connection for push notifications? I used to have a local http/ftp file server running on my Nokia N9/N900 and even on my early Android phones back in the day. I used to still get an all day battery life.
> Imagine losing an email because you walked into the subway and your phone was unreachable the moment an SMTP server tried to connect to it.
Dont SMTP servers already retry a few times before giving up?
Plus it is not like you're using the phone to host content for the whole of the internet. It would be just for your close circle usually.
I am not saying phones make the perfect servers for all kind of applications but for certain kind of workflows... I think Phones are pretty good. Our network infrastructure (NAT, firewalls etc... limited data plans etc..) is the main headache for most of these use cases. But the network infrastructure is a problem even for our laptops, home computers etc..
The point is that while phones are able to do what you suggest, they're not fit for purpose. A phone shouldn't be used as a long-term server because it turns into a fire hazard as the battery degrades. And you can't just remove the battery because most phones won't even power on without a battery (even when plugged in).
At that point, you're better off going with some N100 mini-PC or such. But that's not a phone.
Yep, at that point we've circled back to the original years-long conversation about home servers, except now instead of a cheap mini-PC it's a phone. The distinction isn't meaningful.
And I'll remind folks that we've been talking about the power of people owning their own servers in their homes for decades, and yet the vast vast vast vast majority of users aren't doing it.
For single-user single-device scenarios, that's totally doable. It's called a purely-local app.
Where it gets complicated is there's a (totally understandable) expectation these days that your data is synced across multiple devices, and you can collaborate with other users, who may also have multiple devices themselves. In practice, that necessitates some kind of always-on server that maintains state for everyone. A phone can technically do that, but you'd probably kill your battery in the process.
I set up a service to make hosting those apps as seamless as possible while giving the user control of their data and also sharing revenue with authors to keep projects sustainable. Check it out here:
They however can run their own app or desktop app that can to peer to peer communication. The whole point of self hosting is that we can have data and network sovereignty.
I think, money is not really the problem here. Self-hosting is a shitshow on the same level and for the same reasons because of which package-management on python has been such a shitshow for so many years. There are too many conflicting usecases, and not enough effort for standardization.
> I think self hosting is in a similar spot right now. The apps exist (many are extremely nice!), the software exists, but the seamless, aesthetically pleasing and ergonomic experience does not. It's a pain in the ass to set up self hosting.
if your apps are containerized, setting them up should be possible using some simple script.
So, you rented/bought new server: installed docker, and all following apps could be installed using some docker scripted commands.
The author mostly just hand waves away self-hosting. There's an analogy that compares it to suburbia, but unlike the suburbs where you have to drive 40 minutes to get anywhere interesting, … an Internet hosted service is just as accessible, anywhere. It's a vapid analogy.
The only substantive argument I can see is that the technology is immature:
> Well...without exposing our services to the public internet and forcing our friends to signup for our weird app
Which, yeah, of course the tech is, there's only like a dozen people doing this. The exact hurdle named is hardly insurmountable: in the standards, OIDC overcomes this¹, or guest links. I don't want my family signing up for my weird app either.
One of the other big hurdles is that ISPs like to sell "Internet access", but only deliver half the deal. If you're not getting IPv6 connectivity in the year 2025, I'm sorry, that's a crippled product that your ISP was defunct and didn't properly inform you of when they sold it. (It's a lot easier to self-host on the v6 Internet. Some of my personal services are v6 only b/c of that, and that it works well enough in all but the most extreme or temporary locations.)
(¹but the half-baked OIDC implementations out there might require you to pre-register your app with them. That, rightly, might be a PITA.)
I've thought deeply about this topic but from the pro-suburbia side and I actually agree with the analogy. At a bare minimum if you want to be independent you need a domain which is ~$10/year. That's a small amount but it's already more than most people will pay. (IMO this is irrational if you're paying >$500/year for cellular service but I digress.) Good home servers like Helm (RIP) or Umbrel are $300+ upfront. A good NAS that can also self-host is even more. As you said, if your ISP sucks maybe you have to upgrade to "pro" broadband that's more expensive. Ultimately you're spending hundreds or thousands of dollars on a worse replacement for services that are already "free".
Self-hosting is like spending money putting a swimming pool in your backyard when you could walk to a public pool instead.
Paying $10/yr for a domain is well worth the cost just to be free of attaching your entire digital life to a gmail etc account that can be easily taken from you with no recourse.
But beyond that self hosting is a hobby. It’s not nearly turnkey or cheap enough to justify unless you enjoy the process of self hosting itself.
There are other benefits outside the monetary equation of course like control of which the value is dependent on the self-hoster.
I've always thought it would be great for the government to provide a free domain name for every citizen. There's really not much you can do without DNS.
The one thing I desperately wish Umbrel shipped with was an easy way to network with other Umbrel users for backup and accessibility. Let people set limits in terms of how much storage they're willing to allocate to others. REQUIRE end-to-end encryption on backed up files. But help people create their own community micro-clouds using each other's computers.
To me, the risk of backing things up in one building is too high, but the inconvenience of going even somewhere else in my own town regularly enough to rotate my backups is too high. But if my family members and I could easily back up each other's systems from our various states? Or my group of dorky college friends who are now all over the world could easily share with each other? We'd be all over it.
Distributing your backup over the spare storage of many other NAS servers is the main idea behind Storj, which provides a remarkably cheap price per TB per month.
What I really want, though, is literally just for there to be an Umbrel "Backups" app that lets me choose as a backup location one (or more) friend's Umbrel(s).
Redundancy is the main thing all these Docker-wrapper systems are missing for general use.
I disagree. From experience (see my username), self-hosting is hardly expensive. A $50 ex-corporate SFF with a couple of large M.2 or SATA SSDs will be a lot more powerful and easier to set up and manage than a Raspberry Pi, while not drawing much power. The ongoing costs are larger than not self-hosting, but not terrible - unless you want a symmetric connection, the domain name renewal is the expensive part.
Nope, normies pay with sovereignty. Given the entire ecosystem (Microsoft, Apple, Google and Meta being the main ones) is trying to rob me of it, I'm happy hosting what I need and can handle admining, paying for what I need and can't handle admining, and saying no to the rest.
How is responding nope make sense? Many people don't know to build immich or ZFS etc. I do know some self-hosters losing data from just a poweroutage etc. So there are self-hosters that also cry.
The problem is that people still believe that if they don't pay money, a service is free. But so many do not question why it is free. Hint: Not because Google just wants you to succeed and have a good life. And then, without any second thought, they literally upload their whole private digital life.
I have a .net domain that used to point to the nameserver at my house. It works fine, although if your IP changes you have to update your glue records and whatnot. You can get free secondary DNS service from a several places. All I paid was the cost of the domain registration.
These days I have a Debian instance running at DigitalOcean that costs me $6/mo that acts as my primary DNS, with my home server as the secondary. I'm paying more, but I use that Debian instance for a few other things as well so I don't mind. The major benefit is I no longer worry about my IP changing at home, but it's not absolutely necessary.
You get this wrong. The expensive part isn't the tech at all. You can self-host a lot of things on a old laptop in a drawer while you access it via your routers wireguard VPN connection, without any domain renting.
The expensive part is aquiring the skills needed to pull that off.
I totally agree. I see this "people don't want to do hard stuff" argument used all over - completely disregarding tens of thousands of years of people doing hard stuff.
It comes off to me as the author not wanting to do the hard stuff of working towards their values. Just kind of defeatist and trying to make a splash but leaning on a pretty weak premise.
Most people do not give a rat's ass about the security of their data. They know their social media apps are tracking where they go and who they meet, and they'll say it's creepy if you ask them, but they don't actually care enough to lift a finger to do anything about it.
> completely disregarding tens of thousands of years of people doing hard stuff
a) Just because humanity as a whole did hard things, doesn't mean that most humans did or were willing to. It's perfectly possible that all the hard things we did were accomplished by a handful of remarkable individuals, doing things that the majority never would have been willing to.
b) just because people in one age have been willing to do things, doesn't mean they are willing to do so in all ages. So it's not like the past necessarily proves anything here.
You yourself have hand-waved away an important part - security. It's not (just) about the friction of signup (though, I'll get to that later) - it's the fact that you'd be utterly insane, as an individual developer without a full-time security team, to expose a self-hosted application to the Internet.
And sure, you can give them a login to your VPN, but that doesn't negate the next part...
> and forcing our friends to signup for our weird app
> in the standards, OIDC overcomes this
It's not the signup that's the hurdle. It's the fragmentation. Sure, if you implement OIDC, your friends can sign up to your photo app. And they can sign up to Sam's, and Joe's, and the app of the cute bakery on the street, and a couple others. What then? The whole value of a network is that the components are interconnected and can intercommunicate. If I have to upload my photos seventeen times to seventeen different partitioned applications for my various social groups to see them, I'm just as likely to not bother.
Fediverse-like ideas go some way towards addressing that, but they don't seem to be in any state of usability for anyone non-technical (I say that as someone who was using Mastodon as my only social media for the last couple of years)
> you'd be utterly insane, as an individual developer without a full-time security team, to expose a self-hosted application to the Internet.
You don't have to. The article mentions Tailscale--the whole point of which is to not have any Internet-facing app exposed. Everything is done peer to peer between clients that are behind firewalls. There's nothing listening on an Internet exposed socket for random connections to come in.
I don’t think most people realize how much they’ve given up. Unfortunately it’s a fair bit of work to reclaim everything as your story shows.
I switched to my own modem and router recently for privacy from my ISP and it was a fantastic experience / worth it but it cost some money and time which can be hard to find.
> I don’t think most people realize how much they’ve given up.
I think many are overstating how much people are giving up. People exchange control for comfort, but most people never had any need or ability for this control in the first place. That's why cloud-services became popular, and remain popular.
> Unfortunately it’s a fair bit of work to reclaim everything as your story shows.
This work would be necessary anyway, that's the whole reason why people prefer letting other people doing this work.
> I switched to my own modem and router recently for privacy from my ISP
I'm curious, which privacy can you regain from an ISP, who is already seeing all your internet-traffic? And are we talking here about separate modem & router?
> People exchange control for comfort, but most people never had any need or ability for this control in the first place. That's why cloud-services became popular, and remain popular.
I can--and did for the better part of ~15 years--run and maintain my own self-hosted everything (hardware, DNS, SMTP, httpd, etc, etc, etc). Then I got married and had kids and went to grad school and had a demanding job where I was doing many of the same things I did at home.
I just fucking don't have the personal time nor desire to manage that shit any longer. Why? Because I have better things to do w/my free time than fuck around with my homelab (or whatever the in-term is these days). When I'm done with work, I just want to go outside or read a book.
I am VERY WELL AWARE of the risks and privacy implications; but, my actual freedom from the day-to-day is worth far more to me at this point in my life.
I do the same things (self-hosted server, NAS storage, DNS, email, http for a handful of domains, some development VMs) and it's really set-and-forget. It doesn't require maintenance. Every once in a while LetsEncrypt's certbot falls over and I have to log in to manually refresh ssh certificates, but HN commenters tell me it's user error, so it's something I can also fix to be set-and-forget if I really cared.
My self-hosting infrastructure will probably outlive me.
The person you're replying to said they maintained a homelab for 15 years. I'm sure they have the experience to correctly gauge the amount of effort required. What you're arguing is qualitative. There is _some_ maintenance, as you admitted, and the OP has other priorities.
I personally relate to the person you're replying to. I sleep better not worrying about HDD health or if my APs can reach their controller. Tried it - not for me.
> most people never had any need or ability for this control in the first place
Regarding need: strong disagree. I want to be able to re-read a book, to open it in any an ebook reader on my desktop to search / copy from it, etc. I want to re-watch good movies any time. I certainly don't want to lose my photos or any media I produce because of some corporate policy or quota, or politics.
I self host everything. I only buy what can be de-DRM'd and if it can't be, I return it immediately.
Regarding ability: Sure it's a bit of a pain, but it's not that hard if you're just a bit technical. Everything is done via GUI, there is never anything to type in a console. And if you're not technical yourself, you probably know someone who is.
> Regarding need: strong disagree. I want to be able to re-read a book, to open it in any an ebook reader on my desktop to search / copy from it, etc. I want to re-watch good movies any time.
That's your demand, not everyone's demand. And it seems are also indirectly assuming here that this is impossible without self-hosting, which also is not necessarily true.
The problem, is, we don't know. Self-hosting is like backups, it's working for a situation which might or might not happen; it's annoying, and it can save your ass, but most of the time you will never know if it ever will save your ass, until it actually happens. And until that point, it's just annoying. So we usually don't know if we really want to re-read a specific book and whether it has been become unavailable for us. We simply don't know that, until it happens.
> I certainly don't want to lose my photos or any media I produce because of some corporate policy or quota, or politics.
True, but that's why you should have backups. You don't need to manage a whole infrastructure for all your stuff, when you can also just make regularly backups. Of course, to be fair, most people don't even make backups, or know how to manage them well. But I would say those people can't (or should?) self-host their infrastructure anyway, they would probably blow their own data up in one way or another and lose them anyway.
> I only buy what can be de-DRM'd and if it can't be, I return it immediately.
See, that's your stance, most people don't give an f** about this. They want things now, and don't care for some uncertain future.
> but it's not that hard if you're just a bit technical.
Which most people are not. But it's not about the technical ability, self-hosting is mainly a problem of time, money and habit. Yes, many people can get it done if they invest into it, but they don't, many can't. And that won't ever change.
Most traffic nowadays is HTTPS so as long as you configure your router to use a non-ISP DNS resolver such 1.1.1.1 (Cloudflare) or 8.8.8.8 (Google) then your ISP cannot see your traffic.
However, those ISP branded modem/router devices are completely backdoored and can be accessed by ISP employees for remote support. As they are your router they also get to see your internal network traffic. HTTPS traffic remains encrypted of course, but I personally would never let an ISP have access to my hardware.
If it was easier to do the work yourself I think more would out of privacy, price, and longevity concerns.
Separate modem and router. Using my own modem kicks out my ISP from individual MAC so they can’t see as much device level info. Plus they wouldn’t let me setup a guest network. And now I can monitor the devices myself which is mostly for fun. I run a device VPN when I don’t want them to see traffic but I’ll likely set it up network wide when I have time, which I couldn’t do on their system.
It is not just that it is a lot of work, it is that you lose power, or add a lot of risk. The example doesn't mention backups at all - when (not if) the computer fails then what? How do you access this cloud when not at home - again I didn't see this. How do you share data (only some please) with friends? How will you handle zero-days if the attacker decides to attack you - will you even notice or be the bad guy on the internet enabling attacks on others? Once you get things working when/how will you update - I've had several services that worked good until I updated and something in the config didn't migrate correctly and so it doesn't work.
I have some self hosted things, but because of the above I'm realizing that it is better to find someone to pay to take care of things for me. Someone large enough to get a sysadmin around 24x7, do trail upgrades, write the software/features... Unfortunately finding someone you can trust to do the above is important, and for many things there is no option.
I will likely always run jellyfix (or similar) for legal reasons. However for most things it would be better to pay someone I trust.
- Backups can be sent to the commercial cloud (encrypted) using Duplicati among other solutions. Or just a separate hard drive.
- You access your server using Tailscale VPN, he mentioned it.
- You can allow external access to your apps safely using cloudflare tunnel (per app). Immich works exactly like Google photos and there's even a really good app!
- Each app is in its own container sandbox, with basic hygiene and monitoring it should be fine. And you aren't a profitable target anyway.
- Update require to restart the container with the latest release, your data isn't erased. Solutions such as Umbrel have a community of open source devs doing the updates for you.
Overall, it's not about removing all of our dependency to commercial services, but to do the switch slowly and regain autonomy. Having an alternative, however how imperfect it is (Jellyfin often freezes for me!) is worth it - otherwise the future is bleak.
For every person that has “giving something up” compared to what they had, there are five people gaining what they never had before. That is why these hosted services are popular. They bring cutting edge tools and platforms to people who would never have been able to set them up and maintained them themselves.
That’s not to say there aren’t issues of ownership and control to be concerned about, but they are providing real value to many users, especially those who aren’t technically minded.
Interesting! I'm planning on running PiHole in the near future to block ads at the network level. Excited for some more, "It was DNS" moments.
To the point about people not knowing how much they've given up, I think another way to phrase this is that people don't know how much has been taken away from them. This is why we need better consumer protections for internet services.
I am irritated that "self hosted" seems to mean "in your own house" and everyone just agrees.
To me, self hosted also means I rent a machine with Hetzner and run the server software on it. Its cheap, stable, fast, secure and Hetzner wont screw me over with my data. I have a LOT less headache and I can rent a vserver for a long time until the hardware cost for a server running at home is surpassed.
I can also very simply assign a domain to it
and am pretty sure that software like nextcloud offers oauth access so my friends would NOT be required to sign up for my "weird app". Well, technically they do but oauth automates it.
Why do you claim that Hetzner won’t screw you over with your data?
What you’re doing with Hetzner is just a few less layers of abstraction compared to AWS or Azure. They can still theoretically take down the machine or steal your data, if they wanted to.
I don’t know what the correct definition of self hosted is, but there is a big ideological difference between what you’re doing and self-hosting actual, physical hardware in your home.
Sure, in theory Hetzner could pull the plug or access the data on my VPS. But that’s true of any infrastructure... just like someone could break into my house and steal my self-hosted server.
In fact, I’d argue the physical risk of loss, theft, or data compromise is much higher at home than in a professional datacenter with power redundancy, security controls, and constant uptime monitoring.
It’s a bit like saying, "Don’t trust the bank, they could take your money and freeze your account — keep all your money under the mattress." Technically possible, yes. But come on.
you are not, I consider both self hosting.
I used hetzner for a long time and they were doing a great job. These days I run a server in my basement, because I had the hardware around. Most months of the year it also contributes to heating the house :D
The author gets into a few issues I’ve talked at length about on my own blogs over the years, with the same gist: self-hosting is a better alternative than corporate cloud providers, but isn’t suitable for the everyman due to its complexity and associated costs. The grim reality is that most people and businesses still have such disdain for their own privacy, security, and/or sovereignty, and that’s not going to change absent a profound crisis in all of the above simultaneously (y’know, like what the USA is doing atm).
I do like that the author gets into alternatives, like the library storage idea (my similar concept involved the USPS giving citizens gratis space and a CDN). I think that’s a discussion we need a lot more of, including towns or states building publicly-owned datacenters and infrastructure to support more community efforts involving technology. We also need more engagement from FOSS projects in making their software as easy to deploy with security best practices as possible, by default, such that more people can get right to tinkering and building without having to understand how the proverbial sausage is made. That’s arguably the biggest gap at the moment, because solving the UX side (like Plex did) enables more people to self-host and more communities to consider offering compute services to their citizens.
I’m glad to see a stronger rejection of this notion that a handful of private corporations should control the bulk of technology and the associated industry running atop it, and I’m happy to see more folks discussing alternative futures to it.
> Self-hosting is a better alternative than corporate cloud providers, but isn’t suitable for the everyman due to its complexity and associated costs.
What costs? I run a self-hosted soultion for ~5 people off a $150 N100 machine + storage costs and currently my bottleneck is Jellyfin transcoding speed. I want to scale out with a couple more $150 N100/N150 machines to ~20 users: my entire extended family and friends.
As a point of comparison an iPhone 16 non-pro starts at $799.
That's the fixed costs, the running costs are extremely tiny. The N100 eats up electricity like an anorexic model chewing up red meat, the domain is $10/year and the dynamic DNS is ~$3/month (and I didn't even go for a particularly cheap one).
> What costs? I run a self-hosted soultion for ~5 people off a $150 N100 machine + storage costs and currently my bottleneck is Jellyfin transcoding speed. I want to scale out with a couple more $150 N100/N150 machines to ~20 users: my entire extended family and friends.
Support has costs.
Anyone here can grab an N100 off of ebay, install "self hosting stuff" (much like the guy in the post did), put it back on eBay with a 50-100% markup. "Plug and play, self hosted. Plug in a TB drive for more storage. Total solution!"
And it's still not enough. They need a domain, they need a tunnel, they need to hook up with Lets Encrypt. They need to leave the machine on, and they need a backup strategy. Much less now having to cope with all of the Fine People that inhabit the wild interwebs and will soon come knocking...and knocking...and knocking.
This all has to be explained to folks that don't know, have no aptitude for, and simply don't care, about the mechanics of this process. They just want it to work.
It's not just a couple of dockers shoved onto a small Linux box. It's free like a puppy.
Self hosting is arcane, fiddly stuff. Fine for those comfortable with it, but a nightmare to those who are not.
Yeah, you need to have (I would argue basic) Linux sysadmin skills. If you don't have those skills, and aren't interested to learn them, then you shouldn't self-host, just because it's the hot new trend.
The thing I like the most is the area effect. I have those skills so 5-20 people get a self-hosted experience managed by me. But even so, many people will be left outside of any such area. This too, is fine.
My dad knows how to do basic woodworking, so if I need a simple piece of wooden furniture, I go to him. I have a friend who knows how to 3D print stuff (I know nothing about it) and another who's in medical school and gives me medical advice (including "go to the doctor" when the problem is not minor). But I don't have any friends which are good at car mechanics, so I go to the shop (and get charged) for all problems related to that.
Now, I do not live in the US, so maybe these sorts of relationships spanning wide fields are less common there, but the solution to rugged individualism doesn't seem to me to be "collectivism on a grand scale", be it corporations or the government. The solution seems to me to be "collectivism on a small scale", building friend-family groups that can solve the most common 80% of problems in most fields within themselves, and that reach into professionals from the larger collective for the other 20% of problems, or for the problems in fields they have no experience in.
This. It’s come a long way since the early days of hosting content out of the home off Torrent Seeders, FTP Servers, and Shoutcast offerings, but support is still the biggest bugbear - both end user support, and product support of industry best practices.
Plex doesn’t automatically generate a valid certificate, for instance, even though Let’s Encrypt is a drop-in affair. Home Assistant’s own SSL support is an arcane nightmare out of the box, reminiscent of mid-2000s certificate processes. Proxies like HAProxy and NGINX can better support connection security and encryption termination, but now you have an additional layer to support and manage.
This is what I mean by “support has to improve [for self-hosting to be viable for the masses]”: if something isn’t as easy to setup in a secure manner as install, point to your content, and tie a DNS record to it, then that eliminates 99% of the potential customer base right then and there.
> but isn’t suitable for the everyman due to its complexity and associated costs.
Complexity, sure. But for most people, the cost of Netflix, Spotify and whatever will quickly add up to a 500usd server. With 1-10 users you don't need much.
For 9 out of 10 self hosted programs you can have them up in ~5 minutes with a docker compose and env file.
There are whole OSes built around it, like casaOS which gives users a neat front end/dashboard for their self hosted stuff.
Also for cost eh idk. For $300 you can have enough hardware and storage to self host everything, even a Google photos alternative. Most people spend much more than that on subscriptions for storage, streaming, etc. I guess a UPS is necessary and adds a bit of cost. There are also plenty of pre-built kits for this.
I do agree that it isn't for everyone. Its finicky to get just right and security can be very annoying. Security is already a crapshoot though so I'm not sure that's necessarily a ding for self-hosted.
Docker is still too complex for the layman, and that's ultimately who we have to win over anyway. Big Tech makes it super easy to surrender privacy and sovereignty by giving them your e-mail and a password to create an account and use a new thing. Apps make it easy to do the same, but now for your physical location and device identifiers as well.
Until setting up a private chatroom for your family is as easy as downloading an app on your phone, people are going to keep going back to Big Tech. UX for IT folk and UX for the layman are entirely different beasts, and the UX for IT is only recently improving thanks to things like Docker and the containerization of software making it more widespread and commoditized.
> Until setting up a private chatroom for your family is as easy as downloading an app on your phone
It already is - all my family and close friends are on our own Mattermost instance but it still has them have the same social apps everyone else has because two degrees out are not on our own Mattermost instance :)
This is absolutely ok! As the cost of providing a service becomes less subsidized and starts to reflect the true cost to service a user, more and more people are going to self-host. Hopefully federated networks take off then.
Docker has kida solved the "run application" issue. The real stuff most people care about is the data those applications manage.
If you don't realize what this means (and I won't fault you for it) just imagine what would happen if the $300 hardware and storage were burned down in a house fire or stolen by a burglar.
I self host and have offsite backups on rsync.net and a sneakernet network of people where we exchange a few TBs of encrypted storage with one another to hedge this risk but even then there are scenarios where we could lose valuable data.
> The grim reality is that most people and businesses still have such disdain for their own privacy, security, and/or sovereignty, and that’s not going to change absent a profound crisis in all of the above simultaneously (y’know, like what the USA is doing atm).
That has not been my understanding. My understanding is that privacy, security, and sovereignty costs money and most people and businesses find that cost to be too high. At other times they also dont realize what they are trading off for.
My aunt in the city didn't understanding why I needed a rifle and would vote for no guns policy in the state. When she visited me and we had a coyote incident one night, she understood.
My friends in the city didn't understanding why I have my own well, septic tank and chickens. To them it's a lot of work (it is!) for no good reason, until COVID happened, and they struggled to purchase bottled water, plumbing backed up a few days and food prices shot through the roof.
It's all about cost-benefit analysis. My ex-coworker ex-NSA carries only cash and a rooted Android. I dont - although I am aware of a lot of the risks he's hedging against, in part because that too is a lot of effort that I cannot handle right now.
> I’m glad to see a stronger rejection of this notion that a handful of private corporations should control the bulk of technology and the associated industry running atop it, and I’m happy to see more folks discussing alternative futures to it.
Last time I checked, there are about three hundred thousand different companies offering hosting, all over the world. That's a bunch more diverse than the government doing hosting, as per your suggestion. Or having towns contracting Microsoft for it, which would be the result with kolkhoz or sovkhoz cloud hosting.
> Last time I checked, there are about three hundred thousand different companies offering hosting, all over the world.
Last time I checked, AWS was estimated to have ~5% of all web sites in the world hosted in its infrastructure, while AWS+GCP+Azure combined equate to ~66% of the global cloud compute market. That doesn't even get into the "providers" who are really just reselling major providers at a markup (like Vercel).
It doesn't matter if your town has hundreds of storefronts if one subsidized Walmart is putting them all out of business. Likewise, if every business in town is dependent on the Walmart, then it's really Walmart that controls things and not individual or collective business owners.
I actually thought a lot about this, and I feel it relates to my job in health services.
I'm tired of hearing the Norwegian government talk about AI and modernization. Before we chase the next big trend, we need to solve fundamental problems. We should have one public, centralized provider for digital identity and authentication. We also need a single, secure messaging service for healthcare personnel and residents.
This same principle of focusing on the basics should apply to other services in the domain of selfhosters: secure data storage. Instead of building a complex, all-in-one platform, a community project could offer just a "digital locker" for files.
Users would connect to this storage via open protocols (like WebDAV), allowing it to work with many different apps. This gives users the freedom to choose their own tools for photos, documents, and media. This approach has three main benefits:
* Lower Cost: It is cheaper to manage only file servers instead of a full software suite.
* Simpler Maintenance: The limited scope makes the service easier to secure and sustain.
* Predictability: The service is stable for users, and the workload is predictable for maintainers.
It treats data storage as a public utility—providing the essential infrastructure and letting people build on top of it.
And if a community can’t get this basic and manageable thing up and running, a thing that has immediate and obvious utility, then maybe it’s unrealistic to expect more complex community or public utility-like services.
Thank you so much for your thoughtful comment! I think this is a great path to fight for. I think it's very funny that most people (in the U.S. at least) scoff whenever I talk about a "public, centralized provider for digital identity". There's so much governmental distrust. Meanwhile, everyone I know logs in with Google. Have a great day and thanks for reading!
> centralized provider for digital identity and authentication.
No. Stop pushing this crap. It's what all security companies are lobbying for to get that juicy money and surveillance heavy power hungry governments want to push on next to keep on the path of no anonymity and speech control. They already do it in many ways. Don't hand them the keys for the next oppression. I don't care if your intentions are good. The war on drugs and the prohibition and many invasions also claim good intentions.
Are you against governments issuing passports too?
I don't understand why a government that can be trusted enough to issue passports, but cannot be trusted to issue a digital passport.
Failing to do so will simply lead to Apple or Alphabet being the trusted entity that decides who is who.
Similarly, a government can be trusted to maintain a database of banks and insure the banks' customers' deposits, but a government cannot be trusted to maintain a database of all the people's electronic money accounts directly? (in the US, I know in some countries, the government does operate electronic money accounts and transfers)
It's really hard not to become impolite with this kind of disrespectful comment, but I try. Let me articulate my thinking...
The suggestion is not based on nothing; it's based on years of banging our heads against the wall with various governmental and non-governmental systems that we need to communicate with, in the context of our firm wanting to talk to government servers to, for instance, get money for providing health care, or communicate with a GP.
We already have a need to authenticate and communicate. In the same way we have passports and driving licenses, these kinds of basic utility services seem to be worth it.
I'm just advocating for the same thing, for the basic functionality, digitally, before we start dreaming of other kinds of solutions.
I'm really not happy with the solution that has emerged in Norway, where one private entity is basically the de facto identity provider for everything (BankID). Then there's a mishmash of all other providers with various levels of motives, usability, restrictions, technology, and cost.
The same way we found out national identity cards can be useful, to ensure we have proper basic communication and identification within our country when using that country's services and portals.
This is my logic: We already have to communicate and authenticate, no way around it. And our government is already mandating login and communication digitally. So, a service like I described would not affect the concern you seem to have, since we have already handed over the key, so to speak. But it would alleviate a lot of unnecessary and, frankly, security-reducing complexity.
I would assume you are extremely skeptical of anything governmental and centralized. Maybe you live in a country with more problems, so that your fear is more realistic. But here in Norway, we seem to have found a stable balance of powers and a stable relationship between the people and our government. So maybe your situation you live in makes the "tyranny" claim more palpable.
Sadly, this, to me, just reinforces my experience I have every time I run into libertarian values. There seems to be much more focus on angrily denouncing others' ideas and not contributing to any realistic or practical solution. And it's too bad you have to resort to absolutes, unnuanced ad hominem attack. I think a measured response would have been something like (my caricature of how I would have said it): "I see you want to improve inefficiencies, but I fear that you don't properly account for the dangers of abuse from the government." Instead, you come out swinging when all I suggest is that we just do what we are already doing, but better.
What we need now from this vibrant community of smart, dedicated, part-time sys-admins is to think...
beyond individualism
What we need first is incentive for smart, dedicated, part-time sys-admins to devote time and effort to community hosting.
Without this, it will work --- in the same way that open source works --- without any guarantees or commitments whatsoever.
In other words, you're on your own for the most part. So it really is just a variation on self hosting. By the way, we've already been there, seen that and done that --- it was called "co-location".
When you need something more with service and reliability, well --- you're right back to paying corporate overlords.
I'm part of several small/mid-sized communities where people voluntarily do sysadmin work so that the group can have some nice shared services, and that's to say nothing of the number of people I know running personal homelabs/self-hosting setups at decent cost just for fun. You could of course say that fun, maintaining something for friends you care about, or having a dream of less corporately locked-in software are all incentives, but they're not monetary ones.
Really, it's easy to get sysadmin types interested in this; the problem is that most people aren't sysadmins and don't know any. If you really wanted a business model out of this, it'd probably be a managed service that lets non-tech-savvy users spin up their own versions of this without learning the details.
> Without this, it will work --- in the same way that open source works --- without any guarantees or commitments whatsoever.
There are plenty of successful economic models around open source, and plenty of open source software is used in high-reliability contexts. What comparison are you trying to make?
It's easy to trust a corporate overlord with your pictures or your email, because the immediate damage doable by somebody who has compromised those things is relatively low. Privacy is important I guess, but not when compared to things like whether your car or your insulin pump does what it needs to to keep you alive.
Eventually, the bad guys will be sophisticated enough, and the tech will be integrated enough, that it's no longer safe to trust economic incentives alone. You're going to want your sysadmin to share your interests (in a more specific way than you get from they-also-like-money).
> What we need first is incentive for smart, dedicated, part-time sys-admins to devote time and effort to community hosting.
I’d do it for free. I’ve long been frustrated that I have more reliable infrastructure in my homelab than most companies I’ve worked for, and that none of them have any interest in shifting out of the cloud.
I don’t see a market for it, though. Most people are generally happy with Google, Apple, etc. to host their stuff, and I get it - it’s quite reliable, integrates with the rest of their respective products nicely, and Just Works. Add to that the economies of scale, and it’s a non-starter unless you find a niche group of people.
Google One is $99/year for 2 TB of storage. For me to have confidence in uptime to offer public storage, I’d need at least 4U of colo rack space, and ideally 6U (2x 2U for HDD servers, 2x 1U for hosting applications in HA-ish). That would cost a few hundred USD/month, not to mention an initial outlay of tens of thousands of dollars for servers and drives (mostly the drives… high capacity enterprise-rated HDDs aren’t cheap). And that’s only for one site - ideally, of course, there are at least two, or at the very least, off-site backup like rsync.net.
There is no guarantee that the service you buy will exist tomorrow, and if they go out of business, there is no guarantee you can get your data out before they close the platform.
Thanks for your concern but all my personal data is perfectly safe. I keep it in an old fashioned thing called a "backup" --- complete with encryption.
I maintain 3 copies --- no hosting required. One copy is strapped to my wrist at all times so it is always just as safe as I am --- if not safer.
That’s pretty cool! Especially with how dense microSD cards are these days, you could probably store every (important) photo an average person has without issue, along with the normal documents and whatnot.
Totally agree that without economic infrastructure supporting the model, it's completely unsustainable. Good-will is not a business model. Thanks for reading!
I agree better incentives are needed for community hosting.
Co-location is still readily available. Which service and reliability improvements are you looking for that competent sys admins couldn't provide with multiple co-lo's? Not everyone made the cloud jump.
> When you need something more with service and reliability, well --- you're right back to paying corporate overlords.
Not all corporate overloads are equal. Or rather, if you and your buddies get together and pay the $350+fees to legalzoom to start a corporation, you too, can be a corporate overload. There's still miles to go before you're Facebook, but congratulations, you're now... still the same person you were before you clicked that button on legalzoom's webpage and spent $500 or whatever.
Where is the problem of people turning into corporate overloads for you? Is it at 10 employees? 100? 1,000? 10,000? If we're too stupid to differentiate specific corporations because their legal structure means they're all exactly the same, then yeah, I guess there's no hope and we're all doomed.
There has been a big move to web based apps (SAAS) as web-based software has improved. The biggest plus to web based software for the user is that there is no need to install anything.
BUT, you are going to be paying a monthly sub as long as you keep using the service. And soon as the service goes down (due to financial or other reasons) - game over man.
So there is still a lot to be said for downloadable software, even if it is no longer cool or fashionable. Pay once. Keep your data secure locally. Keep using it until you can't find a computer that runs it any more.
I develop 3 commercial downloadable software products. No plans to move them to web.
Moxie Marlinspike nailed this in his web3 critique from a couple years ago: "People don't want to run their own servers, and never will. The premise for web1 was that everyone on the internet would be both a publisher and consumer of content as well as infrastructure... However – and I don't think this can be emphasized enough – that is not what people want."
That said, the discussion seems stuck in a false binary between the control of self-hosting and the convenience of corporate services, but I think what the market wants is a third way that provides both control and convenience.
And to be honest, public libraries already do this, y'all. GO GET A LIBRARY CARD. You can stream from Kanopy at home.
Exactly! Here in Spain there is a network of web libraries that are proxies of your corresponding local library that allow lending as long as you have a library card. You even have magazines and newspapers, I know because I developed such network!
I don't feel like most people even know self-hosting is an option.
I wasn't aware of how most ingredients were made and what effect they had to my body. Once I learnt I started being way more careful with how I source food.
Same goes with technology: people don't understand that what they upload can be used against them or arbitrarily taken away from them, what they buy can be removed, that companies spy and abuse them. Once they do, many look into self-hosting or at least other alternatives from big tech. I've met many who want to self-host, but they lack the technical literacy to do so.
Totally. You see this happen a lot. Centralization happens for a reason, even if it's a bugbear of a concept these days. It's because the market is demanding it.
How come that a public library, one of the earliest examples of centralized information infrastructure, is not an example of outsourcing and relinquishing control? Instead of your own (small) books collection you get to use some external (huge) book collection. But now you only can borrow a physical book, or some recorded media. You have to return it, and making a copy for personal use only is still a bit problematic.
Either you own and control something, or you do not, there's no third option. A best, you can outsource your stuff piecewise: run your own software on a cloud VM, or bring your own furniture into a rented apartment, or give a valet the keys to the car you own for parking, etc. But there's always some relinquishing of control in exchange to some other aspect of efficiency / comfort.
It's also easy to mistake what most people want for what everyone wants, and miss an important market.
> Either you own and control something, or you do not, there's no third option.
I think there's a full spectrum you're missing. You can own something with other people, and your level of control can be continuous, not discrete & binary. For example, my public library is funded by my local government, which I can influence with lobbying and voting. I can join the board of the library, and I can just go and talk to the librarians in charge to influence their decisions.
In an individualist consumerist mindset things are pretty stark : full self-hosting or full submission. If you reject that mindset there are many more options.
As a public institution you, the citizen, own it. What you are talking about is hoarding access. You want complete unfettered access to content without barriers and without friction. Typically the only way to do that is via pirating.
Let me remind you of the open source credo about free as in freedom not free beer. You are right that there may be exchanges or compromises at play, but it was a bit shocking to me when talking about what is essentially the digital commons that no one mentioned a library, which exists.
I'm also saying from a practical perspective if you want to stream movies without giving money to big tech, you can literally do that tonight with a library card. The infrastructure already exists.
> As a public institution you, the citizen, own it.
Nominally, yes. In terms of that meaning anything, no. The benefit of ownership is not exclusivity, but control. If the library doesn't have a book (or other piece of media, of course), I have no power to influence them to get it despite that theoretical ownership. If the librarian decides a book is offensive and removes it from the collection, I have no power to influence them to keep it. I have to live with someone else's decisions about what the library does and does not contain, just like with a commercial service. So my nominal ownership really means nothing at all.
> That said, the discussion seems stuck in a false binary between the control of self-hosting and the convenience of corporate services, but I think what the market wants is a third way that provides both control and convenience.
If I were to run my own version of Google Photos and the like, I'd probably go with the hybrid option:
Run all the software I'd run if I was self-hosting, but in the cloud, possibly with a backup in a second cloud. ie, put my photos in Backblaze B2, with second copies in S3 or something.
Personally, half the reason I use Google Photos is so that if my house burns down, I don't lose my pictures. A self-hosted server running under my desk doesn't carry that guarantee. Backups are off-site for a reason.
Though maybe self-hosted at home with a single cloud backup would be good enough.
When running your own backup server, you're forgetting about scenario(however less-likely) when Google Photos will loose your photos, or if your google account gets banned with no ability to call anyone in Google to dispute that. In this case you can safely rely on your own backup to have those files at hand.
I was skeptical about this scenario until one day Gmail lost 1 year worth of my emails. It's just gone. All other emails are there, but not this particular year. And there is no person who you can call to talk about that.
I want something easy to set up that lets me easily backup things like this within a user-chosen circle of family or friends. Build my own trusted "micro cloud."
They're missing the key feature I'm looking for: Decentralized backup to the same devices owned by people I choose. That's the "someone else's computer" part of what I want in a "cloud."
I can already easily run such things on my home computer. It's having remote (encrypted) backups and redundancy if my own system goes down that I'm looking for.
Moxie is wrong, he likes to project his own ideas as wisdom and always factually correct. P2P networks have flourished. Bittorrent, bitcoin, Tor just to name a few successful ones
The size of the whole pie has grown, and, yes, so have P2P networks.
However, centralized networks of various kinds have grown too. From application-level networks (e.g. networks messengers from Signal to Discord; payment networks from Visa to AliPay) to transport- and network-layer networks (e.g. cloud-oriented client-server topologies; Tailscale), you see growth in the centralized world too. While I don’t have hard data, I’d casually assert that that growth is comparatively far larger than the P2P growth.
Also, if you’re referring to Moxie’s classic post about centralization vs. decentralization[0], I think you’re mischaracterizing it; it doesn’t claim that P2P is altogether inferior, wrong, or any such thing. I’d summarize his point as being that anchoring your application to a decentralized P2P protocol makes your application development less agile. In other words, there are engineering tradeoffs there, between centralization and decentralization. When he weighed the tradeoffs for making Signal, he came down on the side of a centralized architecture.
I don't agree with the premise that people don't want to be part of the infra. The real problem is that gate keeping is a great business model. It is so profitable to create a wall garden that companies compete ferocely to take care of you content.
If you can't actually download a copy of a digital content as a mere file, then you can't really host it and serve it.
You can't host your own Spotify-clone even if you are allowed to listen to songs. However, you can still download music on Bandcamp to feed your Spotify-clone.
You can't host your own your own digital Video Game Store usually because of various DRM, or because it's painful to "export" the content and painful to "import" it back.
Still on the video game side, You can't even backup your game save (at least on the Nintendo Switch, Nintendo Switch 2 and Xbox Series), it's not because of any copyright infringement or IPs misuse, it's only a way for them to get more online subscription with online game save backup.
There is still a positive side: when it will become impossible to legally own anything, I'm pretty sure some illegal system will enable you to have a massive library of whatever you want at the cost of few clicks and/or a couple of bucks.
I'm saying "positive side" even though it's illegal because I mostly talk about the comfort of having your own local library.
Totally. There's a whole other article somewhere in there about the, "If buying isn't owning than piracy isn't stealing" sentiment online. Thanks for reading!
Exactly. It's a great article, but the depressing part is that there's a very limited catalog of legal media available to use these services with (except for immich, I suppose).
For games, there's GOG. Good luck finding bigger releases.
For music, there's Bandcamp and CDs and vinyl. Fortunately, most albums still release on either one of these.
Audiobookshelf can be used for most podcasts (some do not have a traditional RSS feed and are in some walled garden) and some audio books are available DRM free, but tons of books are Audible exclusives. I'm relatively sure that they also stop authors from publishing e.g. on Royal Road once they're on there.
The same is true for e-books - HumbleBundle and co are great, but good luck finding certain titles. I regret buying a new Kindle, but at least had the foresight to download all my books before they stopped allowing that. Physical books are an option, but that's not an equivalent to en e-book.
I stopped caring about TV shows and movies a long time ago (largely due to the atrocious streaming fragmentation, pricing, and the sheer audacity to include ads in paid plans), but I assume 95% of all shows are exclusive to some streaming giant, too.
Couldn't this be solved by technical means? All those self-hosted boxes in people's homes could federate. That would allow the friends to upload their photos to an album. If you want to have copies of them on your local hard drive, a config flag could duplicate the data, automatically providing redundancy that's even useful for others. Not everyone wants to run a server at home and thoae who don't want to could rely on some third party, be it a public library, a non-profit, or even a for-profit offering some extra perks. The basic tech could be all the same, even the software stack.
I wonder if there are any startups in that space, there likely are. YC anyone? Whatare the obstacles?
Is Peergos the answer I'm looking for? If so, what's missing is a big push on the business/PR side. They'll need to replicate what Signal did for chat so that even my 80-year old mom can use it.
Am I crazy or did my 2006 iMac come with a home media server for serving movies / tv shows / music photos from your filesystem. I think it even came with a slick looking remote!
You could stream content from it over your home network (as long as you were connecting from another Apple device)
Is this lost technology or just a figment of my imagination? I've long since switched to linux and run the typical Jellyfin setup etc
I’ve never had an iMac but my MacBook Pro circa 2009 came with a media remote. There was an infrared receiver on the body of the laptop in the front corner.
> Kindle users would no longer be able to download and back up their book libraries to their computers
I should create an account that posts nothing but the phrase "Stallman was right". I'd have work every day.
Anyway, I have a Pocketbook[1], recommended. Got the cheapest one, cost me something like 100 pounds. Doesn't need internet if you don't want it, and supports all the usual file formats.
Users don't know what they want. There is simply a lack of vision for a human-focused self-service platform with a hook to get ever-expansive services over consumer-grade internet.
Corporate/investor greed is a limiting factor to the design. Network security and hardware/software vulnerabilities are the near impossible barriers to long-term viability. A solution basically needs to be unhackable to compete with cloud.
I have a platform vision that would definitely work, but I have no idea how to solve the greed or security issues. (No, Rust won't solve it! ;)
EDIT: Oh, and nation-state actors and corporate espionage. An independent, successful cloud competitor would be a prime target - they'd be relentless and burn it to the ground. Impossible problems.
Yep, gotta sneak it into their network under the cloak of some other product and then go, "oh btw, it's like a cloud. Here's our new 2026 features you can buy into." Only then will they realize what is possible and decide they want it.
One company comes to mind that is uniquely positioned to capitalize on the current situation by offering a convenient self-hosting solution: Ubiquiti. Despite their pretty bad missteps 5 years ago, their UniFi product range is still very decent and user-friendly for SOHO/SMB networking, and they seem to have the appetite to continue expanding their product line into adjacent markets.
I have deployed simple UniFi setups for all my relatives, and they are very happy (though they couldn't have done it themselves). IMHO, they have the DNA to go further and offer a full self-hosted cloud, if they're willing to put in the effort to make it even easier and more integrated.
I'd say self-hosting on the verge of becoming ubiquitous and accepted.
The whole sales pitch of cloud providers is that instaling and maintaining a server is just too hard for the average Joe.
Thing is the average Joe already has at least 2 dedicated servers in their home - their router and their IoT hub. Both are designed to be servers, and talk to third party endpoints over the internet.
While I'm not crazy about IoT, I think we are reaching the point where most people have something digital in their house that makes sense to be networked.
And thanks to IoT stuff, running and managing servers has become a certified Dad activity, like woodworking and home improvement.
I know multiple dads, who had no prior exposure to IT, who have set up rather complex Raspberry Pi based home automation systems, managing all the complexity of setting up and running a server at home.
I think the skills and interest are proliferating, and it's no longer going to be accepted wisdom to just rely on some nebuluous remote cloud provider, esp for simple stuff.
I like self hosting . It’s not just about privacy or owning something. To me a homelab is also a hobby. No different than previous generations that tinkered with their cars as a hobby. As someone who works in IT - there are also ancillary benefits. What I learn at work, I apply to my home lab and vice versa.
To me, the major issue of self-hosting (once overcome the tech barrier etc...) has always been protection. Not from external actors or attacks, but from incidents. By which I mean backups. Safest option is online backup, which is expensive and takes your data sovereignty away once again. Or I can once a year make a hard copy and take it to my parents (who live in a different country) for storage, and swap the backups out. Either way, very suboptimal. If anyone has a good way to achieve this, please lmk
There have been solid efforts with niche adoption that have quite nice UX like Umbrel [1] that allows installing all the mentioned and a ton more open-source apps [2] just by using a UI. It was spawned as bitcoin node hardware+software combo but expanded and is now primarily about self-hosting.
The rise of better home internet connections worldwide will make this even more attainable for more people. At least on my low-level EU country that has been always lagging to progress tech-wise, we've seen great progress on fiber internet adoption, so I have hope of acceleration.
There are many solutions like Umbrel, but they all suffer from limited amount of apps, and depending on someone maintaining them. You basically have to choose them by which apps you want to use, and how that it will get maintained long enough.
What we need is something more universal, like a more userfriendly docker, or something like flatpak+hub for server-apps.
It sounds like the author never heard of a VPS? Yes it's someone else's computer but you own the contents, can switch providers any time.
Personally no I would never host cloud connected stuff at home, but neither would I trust Dropbox or Kindle with my stuff. Although actually why ebooks need to be in the cloud at all I don't know - just buy somewhere that lets you download and keep them on your device/backup storage? If my eBook reader ever said I couldn't side load books I would hack it so fast..
Yeah, I chose to ignore the VPS angle because I feel like it presents essentially the same problems as self-hosting – just on rented hardware. It didn't really serve the story. But I get that omitting this makes it confusing for more tech-savvy readers. I use a VPS with Dokploy for hosting apps, but I don't know if I'd use it to host my photo library haha
Also, I'm actually working on jailbreaking my Kindle and will probably write a future article about that! Thanks for reading and commenting!
Cool, enjoy jail breaking Kindle. I live for liberating my devices, mostly old android phones and laptops that somehow have the latest updates despite being long forgotten my the companies who made them.
I still remember the iPod my wife and I bought to take our music with us while travelling, only to be told we couldn't transfer the mp3's to our laptop. Hacked that thing and never looked back!
What. The article reads just as an ad for clouds. It tips into the benefits, ownership problems, setup. Then it says "but how do I share photos???" and this apparently is enough to counter all benefits.
Even if I had to (and this is what I actually do actively) push the photos I want to share to Google Photos, ALL the benefits remain. I see it, it's a slight inconvenience of having to do like 2 more taps and wait for the upload, but that's it. You get so much for this small inconvenience. You own your data, your infrastructure, you're not locked in, and your data is private. But having to share the photos via another app is the dealbreaker?
I can't see community-hosting taking off. I do not trust anybody telling me about E2E encryption that I can not prove.
I barely trust Google.
I trust the long bearded neighborhood nerd much less than most companies. Even if I probably am that person in my neighborhood. But nobody should trust me, and I am not going to tell them to trust me.
Even if everything is encrypted, I can almost guarantee that the community shared server will be confiscated by the police once in the next three decades.
Yeah, trusting people and systems is hard. But we live in a society and trust is just part of the game. For me, I am far more likely to trust a community of people that all build, operate, and own a service we all rely on than a company that will sacrifice anything for profit.
It's interesting to me that recently people have started equating self hosting with having a physical server in your house.
Beyond that, the "how do I talk to other people if it's on my server" thing is generally solvable. Give them an account on your server. Don't want to need to make an account on every friend's server? That's why we have SSO technologies. I don't think. Self hosting and community collaboration need to be incompatible.
> Self hosting and community collaboration need to be incompatible.
Totally agree, but there's a lot more nuance here. Giving each friend an account on my server would require it be exposed to the public internet which is difficult to manage securely. And SSO doesn't really make this very convenient because that means everyone would have to sign in and sync to everyone's servers which is a lot of work for the user. It's a UX problem.
The solution as I see it here is services that can interoperate and sync files across hosts. So, my friend's Alice and Bob can both have their photos synced to a separate server and can choose which photos to share to my server. Separate but connected.
Right, the services should allow federation, but that doesn't mean you need to federate with the entire world. You and your friend should be able to just click "invite" in your "My Home" app to get a link to text to each other like `myhome://invite?domain=<random>.services.frienddomain.com` (or a QR code flow). Under that TLD you have well-known subdomains and TXT records for e.g. wireguard config, oauth server location, etc. When you open the link in your "My Home" app, it adds the wireguard peer and starts trying to perform oauth client autoregistration and federate any services you run. When your friend clicks your link, it'll set up the other half of those connections. Once you've both clicked, things start talking to each other. This all stays invisible to the normal Internet for anyone that doesn't know the root domain to search for records under.
This could all run on one of those $130 N150 minipcs that uses like 8W and could run 24/7. It's a lot of integration work, but there's no reason why it couldn't be a fairly off-the-shelf product.
You could also explore other service discovery patterns since buying a domain name is a pain. Like have the URL provide the initial wireguard config (including outside IP) and DNS search domain, and then the servers on each end can query (private) DNS on the other end via the tunnel for services.
There was a time (around y2k iirc) where you could buy a box preconfigured with databases and so on, there was a movement to make these things 'appliances' like toasters but the winds changed, sun and oracle were selling them and maybe netscape? I have a time capsule (which is still working) sitting in the corner quietly keeping backups for me - I don't do anything to it and it just keeps working. Maybe the issue isn't that the future is not self hosted but the future is appliances, it would be nice to have a server thing with some icons on it to make it a photo server/database server etc.
One of the reasons people use the cloud is because these things have become hard to set up, they really shouldn't be.
I think people are dismissing the possibility of universally accessible self-hosting too quickly. We really need to be ambitious as engineers and imagine a future where people have sovereignty over their own computing. In 1990, we wouldn't have accepted someone else taking custodianship of our personal documents, memories, books, music, and films, and yet it's normalized today. With the benefit of hindsight, we need to brutally simplify every single layer of the stack and optimize it for being usable by non-technical people.
Thanks for your comment! I still think though that this puts way too much on each individual – no matter how easy you make the tech. But, I could see a world where just like running tech support for my parent's computers, I also do so for their server. That's an interesting take!
Not sure if others mentioned this but one can abstract away the configuration and sys-admin type tasks using a declarative language. Then the setup can be recreated effortlessly by others, reviewed and verified on an ongoing basis.
If the author found a self-hosting setup that works, it should be packaged and automatically reproduced elsewhere. It is always 10% of the work to make something work, 90% of the work is arranging it to be self-reproducing, self-maintaining, and self-documenting without excessive toil. I call this "self-*" computing.
I’m never clear why the solution I have - a kind of hybrid of cloud and local - isn’t more popular.
I make use of google drive, apps and google photos and therefore suffer the knowledge that my stuff is probably being used to train AI (I’m personally comfortable with this) - but then I have local backups and sync for everything. InsycHQ gives me a locally (and NAS) backed up version of all my documents, I also backup all photos shot by my wife and I to my Synology, and then daily backup in 2x places that I own from there. My films and media are locally stored, and I buy a fair bit from BandCamp and I use Plex to serve but I also have Spotify for the convenience factor. …and so on
In other words - it’s a sort of multi-tiered approach. I’m not subject to the whims of cloud providers because if they change their pricing or terms radically I’ve still got all my stuff locally; ditto backups on infrastructure that I own and control in-house.
It’s always seemed to me like this is a pretty good setup, combining the utility of cloud with the reassurance of self hosting.
I think that's a great setup! I actually am still using Google Photos for this reason. I think of it as a kind of "offsite" backup. I take a lot of photos and videos though so I'm probably going to have to move to a more affordable approach like Backblaze. Thanks for your comment!
The fundamental problem here is that bad apples don’t respect common sense agreements. If everyone who owned a kindle book, agreed to never share the downloaded version of the book for free on the internet, companies would not have to do this. I don’t see what’s the solution, if buying a kindle ebook is allowing you to share it for free on the internet. In the past people were limited by a physical copy, they could give the copy but only 1 copy could exist at a time, now without that limit, people need to do something to protect against piracy. I don’t like this solution, but I don’t see what’s the alternative?
I see this claim often but bypassing DRM is an inevitability to the point where it's commonly done within hours of a new release simply for the fun of doing it.
And to quote Gabe Newell (founder and owner of Valve, the company that operates Steam):
> "We think there is a fundamental misconception about piracy. Piracy is almost always a service problem and not a pricing problem," he said. "If a pirate offers a product anywhere in the world, 24 x 7, purchasable from the convenience of your personal computer, and the legal provider says the product is region-locked, will come to your country 3 months after the US release, and can only be purchased at a brick and mortar store, then the pirate's service is more valuable."
> The proof is in the proverbial pudding. “Prior to entering the Russian market, we were told that Russia was a waste of time because everyone would pirate our products. Russia is now about to become [Steam’s] largest market in Europe,” Newell said.
There are certainly cases where people will pirate to avoid paying but in the event that the option to pirate is not available, they will generally just go without instead. The only situations where piracy really becomes a matter of pricing is in the openly exploitative services like Academic Journals.
If you have 2 options, get the product for paying a market price, and get the product for free, I think 90%+ of all humans will get it for free. The only thing stopping them is friction and consequences. I’m not as optimistic as you, that the only reason people pirate is because it’s available in their geography (why not use a VPN and buy it then). Some people will pay for stuff, I never use pirated stuff, but I’m pretty sure that group of humans is a rarity.
This is provably false. I and everyone else here can get almost any book for free on library genesis right now, with less friction than making an account on Amazon and entering their credit card information. Do they? Most people I know don't.
Hah. I love how you put the alleged rights of companies over the rights of people.
"If you buy our Hulu Movie you can only watch it up to 4 people. We'll install cameras in your house to make sure you're not sharing them with a partner. What else can we do if you don't respect our increasingly shittier terms and conditions?"
Come on, man. No one guarantees you total security. Make good products. The belief that you have a right to surveil and intrude to protect against piracy is just so ludicrous. Specially when companies are constantly abusing people for profit.
> Which raises the question: do they even own those books?
nop, but legislators should really force that anything bought without "deadline" also doesn't randomly disappear/cost extra no matter if you bought a license or not
in additions license with clear deadline should always be required to have a "be aware that this product has only a limited guaranteed availability of ... days/month/years _dialog_" which you need to agree on and which isn't allowed to be just another checkbox (which yes seems mean against companies, but their is no reason to not treat scam like, abusive business practices meanly. It's kinda the point of countries to fight against anything harming their citizens weather that is abusive business practices or violence .)
Sure, you can own your server and have it at home. It must be nice to have enough space at home to dedicate some to a server room (servers are noisy btw). But many people live in small apartments in a city and so don't have that luxury.
You can own your server but rent some rack space from a data center to put it into. That would still be self-hosting.
You can rent a virtual or dedicated server from a hosting company, and even that would be self-hosting.
The author seems to not consider the fact that this is a spectrum but also, from a practical standpoint, mostly the same thing.
> It must be nice to have enough space at home to dedicate some to a server room (servers are noisy btw). But many people live in small apartments in a city and so don't have that luxury.
Absolute bullocks.
For most people running a home server, a Raspberry Pi is plenty and is about the size of a deck of cards, maybe two decks if you want extra storage and use an external storage device.
If you need something beefier, you can probably just use an old laptop, or maybe a full second PC under your desk if you need more. You could easily fit a Threadripper or Xeon system with 128 GB of RAM, multiple drives, and a GPU or even two in a single ATX PC case.
If you need a full server rack, you're an extreme outlier beyond even 99% of homelab creators.
You're right! Having a VPS or similar offsite server is also totally self-hosting! Just for the sake of narrative and suburbia analogy, I chose to leave this detail out. Like you mentioned, practically they're mostly the same thing and come with the same pros and cons no matter where the server is. Thanks for your comment!
I disagree that you need a lot of space for self hosting. Unless you want to host streaming content for thousands of users, Intel NUC or raspberry PI on top of your router is plenty enough to host nextcloud, some webservers with decent traffic (assuming you have gigabit connection, which is now commonplace), email, backups and media server for family and friends.
Wouldn't it be rather awkward to set up a redundant RAID array on one of those though? Which is something you definitely want on a server that stores backups. I know you can obviously connect as many hard drives as you want to a Raspberry Pi via USB, but that feels wrong for a server. Intel Nuc at least has Thunderbolt and probably some internal SATA ports.
> You can rent a virtual or dedicated server from a hosting company, and even that would be self-hosting.
That's what I do. I use Linode/Akamai, which now has encrypted VPS instances.
Ideally, I'd have my own hardware but I don't want to deal with the maintenance and failure cases (house fire, etc). I think a VPS is a solid tradeoff.
What? That's the most ridiculous argument I have seen to justify not have a homeserver. Even in the smallest places, it should not be that hard to fit a few low-powered and high perf min PCs and few SBCs. It's all about how badly do you need that control and freedom
Do you really need to self host all these apps just to "take ownership"?
All my pictures are stored as plain files in various folders on a big networked hard drive. So is all my music, audiobooks, movies, documents, projects, etc. This is backed up 5 times over to more hard drives periodically. I give a couple to family that lives out of state when I visit.
You might laugh, but I'm not really sure what I'm missing that would have me do something else. And yes, it's work to take care of it, but that's true of any of your possessions. Just give me my files, man.
Totally! Before going the full self-hosted route, I actually had an old computer I used as a simple NAS. For this project, I was just looking to make everything as easy to use as any other app my wife and I were used to.
If this is the goal (and I think it's a perfectly commendable goal), you being afraid of the public web makes it basically impossible.
Honestly - just make the service public. Let your wife share links to her photo albums with her friends - have them point to your domain.
Make your friends make accounts on your services if they need to - or better yet, provision accounts automatically for them (I do this).
I understand the fear here, and I get it, but I also think it's widely misplaced. Pay a small sum for backups, rotate them, and let it rip.
The suburban web is actually pretty good these days (at least in real suburbs, I have 2gbs/down 1gbs/up in mine) and it basically only gets better.
---
My experience comes from hosting several sites for my family (including extended family in several different cities and countries) and also several sites for my neighborhood. The vast majority of them are public (as in - there is a public domain that resolves to my services with no need for preshared secret [aka: tailscale or other wireguard based vpn]).
Yes, you get clearly bogus traffic scanning for the lowest of low hanging fruit (ex - php_myadmin/wp-admin/etc) but auth solutions have come a long way, and I don't even bother blacklisting/fail2banning anymore. It's a waste of time and effort for small peanuts.
It's pretty easy to configure SSO pointed at something like Keycloak/Authelia and then have your friends get a centrally managed account with 2fa required. Ex - Jellyfin, Bookstack, Gitea, Immich etc... I host all of these (and lots more) and SSO support is pretty good these days.
Personally, if all your public infrastructure is behind a keycloak login form... I don't think you're going to have many problems.
---
Side note - this is one perfectly acceptable strategy to reach the point you want (community based self-hosted solutions). I host services for my neighbors & family. Not every household needs to be an expert, and no need to get the gov involved (not that I mind the idea of a new digital services library, either).
But fear of the public web means you can't ever reach that spot.
Thank you for your comment this is really enlightening! I'd love to learn more about services you're hosting for friends and neighbors and how that works technically and socially. If you're interested in connecting – please email me hn@drewlyton.com
That website lists Hugo, the static site generator. What kind of self-hostable service does Hugo provide??? Confusing info like this makes me doubt the rest of the entries on that page.
So, the thing we have right now is Tailscale - and it's freaking awesome.
But I want the next thing. Which is like Tailscale2, but for people, not machines.
I want to tell Tailscale2 about all of the people in my life, and which of my self-hosted apps they're allowed to talk to. And if they're also running a self-hosted app, then I want our apps to federate together.
It feels like we're suuuuuper close to having this.
I get that you can basically do this with Tailscale. Basically. But I want the next thing to be designed from the ground-up around this kind of design. People, sharing apps with each other.
Tailscale lets you grant various admin roles to other users, but it does also let you share individual nodes to people. Maybe that suits you're needs? It's on you to manage the human trust relationships though, but no technology can fix that problem for you.
LLMs slot into this conversation in a really interesting way.
The things the author set up are technologically mature enough that, as long as you have the media, or as long as you can get your friends to use it, the self-hosted versions are largely better than the commercial ones. The last decade or so of innovation has really been about figuring out how to monetize these technologies, at the expense of UX.
This is in contrast to LLMs, where the commercial ones kind of wipe the floor with the self-hosted options.
On the other hand, LLMs essentially give average people superpowers for self-hosting mature technologies. My wife used Claude Code to vibe-code an educational game for our five-year-old, tailored to his preferences and the skills he needs to work on (she's a UX designer and now, a couple weeks in, reads enough Javascript to understand when Claude is doing something stupid).
If we want to buy a computer to use a server, write, and host a bespoke family to-do-list / photo store / knowledge base / calendar that syncs my wife's Google Calendar with my .org files ... we are so much more able to do that than we were even two years ago.
Totally agree! I relied a lot on Claude Code to help me with issues I was having setting up hardware encoding in Immich. But I also think – as accessible as LLMs are as a tool – they still don't make the complexities of self-hosting trivial. Maybe they'll get there, but I feel like LLMs really are just another coding abstraction. It's like a programming language. You still need to know how the language works and how the underlying "bare metal" works to make anything reliably.
But, I could be wrong! Thanks for reading and commenting!
I think Synology NAS is already 95% there. So the technical difficulty isn't much of an argument. Sharing of Photos also isn't a hurdle, mostly because I use Whatsapp for it.
I think the biggest pain point is that Microsoft, Amazon, Apple and Google all wants services revenue. And they will go out of their way to force everything on their platform to become subscription based and you dont own anything.
I host a immich server that is publicly accessible and is mostly locked down. I've never had an issue with sharing an albium. It makes a configurable public URL that you can share out to people on whatever medium that you'd like.
What I see is that it's trivial to 'self-host' locally - go buy a product from Synology/QNAP etc. - they have an ecosystem, easy setup, apps, everything. Three issues from my perspective: 1) cost and 2) security+privacy 3) not so easy to integrate networking (visibility from internet side) for things like email hosting.
I can also see it possible to 'self-host' things once you use a cloud where you can do 'confidential computing' stuff aka. the hosting provider does not have access to whatever it is you're running. That functionality is there on the major clouds now (EC2, Azure, GCP) all have the Intel/AMD/Arm TME/SEV/RME stuff implemented but finding it on a device that you can self-host in your little storage cupboard is impossible right now (EPYC 9004 seems to be the lowest available with that technology). At a minimum you want secure boot + attestation + memory encryption if you are not in control of the hardware space itself.
This is what I imagined when reading Neuromancer and other sci-fi of that time. A public online space that we share. Sure, some corners will get gross and dangerous. But that's what humanity looks like.
It's strange to me that we never included public spaces in our growth and innovation of the internet over the past 30 years. Of course I expect companies to do their thing as they've had free reign to do, but it wouldn't have taken much cost or effort to add a couple publicly funded data-centers where everyone gets a little space for themselves.
At least in the US, I think it's because we've allowed those who run our government to get far too old. The people running the country have not really understood the public good of the internet outside of commerce. Don't get me wrong, I've benefited from said commerce for my entire career, but I think we, as a society, have lost quite a bit of ground by not collectively owning a piece of this thing as it grew.
Once upon a time the airwaves were ours, and music thrived because of it. These days the airwaves are all practically walled off with massive monopolies controlling them. It's an overall detriment to our creative progress.
I know I'm an old man barking at clouds, but I miss the radio from when I was young - there was actually new and interesting music there. The internet feels the same way for very similar reasons.
The title is showing quite a lot of ankle! OP is a proud self hoster.
I run my own email, DNS and the rest. Yes: email. I run several domains including my own company and my own vanity domain and several more for friends. I have been doing it for decades.
Goog, MS and co do follow standards and if you do too, they will be largely merciful if you keep your nose clean. I have even managed to run an email system from my home connection as a test IPv4 and 6. I'm UK based. It does seem that IP denylists do seem to be a bit brutal in the USofA, so that might explain the downer meme on self hosting email.
The future is and always will be self hosted if you give a shit.
Haha! "Showing a lot of ankle" – I've never heard that before! Thanks for reading and commenting – very cool that you've managed to successfully host email. I'm sad advertisers and spammers have turned that into essentially an unusable technology.
Definitely a proud self hoster, but the main point is really that I don't think we're going to live in a world where self-hosting is the dominant method of using internet-based apps and services. Would love to be wrong though! Maybe we'll all be self-hosting email in a few years!
The actual solution is extremely simple in explanation, though really hard to pull off.
It's "skin in the game." Right now, cloud services fail horribly at much of what they promise or merely imply; safety, security, long term availability, etc.
And so, to make them not fail at this, they must be punished when they fail at this. The other side of this coin is probably "you have to pay them," but that's not so bad either.
so you watch videos, listen to music, read books, and take/share photos on a phone, ipad, or tv. you seek a better experience doing those things, and your solution is to spin up some software _on a totally new device_ (a server).
that's a huge leap! i think most of us gloss over it, but the rest of the article is predicated on that leap.
the tv you're streaming video to probably runs Android by now. it has a stable internet connection, CPU, RAM, and probably a couple USB ports. why not install the Jellyfin server software on it, attach a USB hard drive, and let it be the machine that hosts all your media? why, actually, do you need to go out of your way to buy a completely new machine for this?
similar argument applies to Immich. you're wanting to co-edit an album among several contacts. you're probably all uploading your photos from a phone. why not just have one of your always-on phones host that album? i shouldn't expect the drain on your battery to serve an album to a few friends is that much more than it took to take those photos in the first place.
to a certain degree, you're "self-hosting" things on a physical server because that's the only platform on which we all still have the ability to run arbitrary workloads on. solve that problem and everything becomes a _lot_ simpler.
Future is, unfortunately, probably getting back to piracy in some shape or form. Especially with the general idea of the industry that buying something does not mean you own it. In that case all I can say is: F'em.
It is definitely true that piracy is primarily a service problem, not an ethical one.
One thing i know about the future is that it brings more powerful chips, available storage and more tech in general. Which is much needed to come up with consumer level self-hosting solution so that 'cloud is just someone esle's computer' becomes 'this cloud is just my computer'
Certain things will be cloud-based or otherwise provider-hosted. Some things will remain self-hosted, for those who prefer it.
It's like owning a car: you take the trouble to maintain it, but it's yours and will take you where you want, without the limitations of a taxi or even a rented car. I live in NYC and don't own a car, for I have too little use for it. OTOH if I were a plumbing contractor, I most definitely would own a car, or maybe a light truck. One size does not exactly fit all.
I sometimes wonder about "managed hosting" (or whatever it is called). For instance, some providers like Hetzner or Infomaniak offer a "Nextcloud managed instance". So you pay a subscription and they maintain your Nextcloud instance for you. Which is presumably simpler and safer than doing it yourself at home.
On such an instance, one can share a folder with a friend, for instance. And I think Nextcloud is even working on federation (?).
One disadvantage is that they have access to your data, but at least you choose the cloud provider (maybe you want one that is in your country).
> One disadvantage is that they have access to your data, but at least you choose the cloud provider (maybe you want one that is in your country).
You can apparently encrypt your Nextcloud data at rest at Hetzner. I host my own Nextcloud, and I know it supports encryption, but apparently Hetzner also allows you to do so.
On the other hand, if you want a standard cloud provider, pCloud provides good encryption support. Also they have a nice FUSE based client, and they're interoperable with tons of tools, too.
Returning to Nextcloud, you can share files/folders directly (with expiration/password) or add more users with limited access to your folders.
BTW, keeping a Nextcloud instance is really easy, let it be container based or bare-metal install. It never let me down over the years.
> You can apparently encrypt your Nextcloud data at rest at Hetzner.
Doesn't it mean that they can still access your data while the server is running? I mean, they run the server, they must have access to it, right?
> pCloud provides good encryption support
You mean e2ee? If it's about sending files to an untrusted server, I use restic. Works with pretty much everything (including pCloud) :-).
> BTW, keeping a Nextcloud instance is really easy
Sure, but what I was saying is that either you do it at home and it makes it harder (you want your home LAN to be secure :-) ) or you do it on a VPS, and someone else has access to your data.
How about an all in one box, like phones or synology boxes that come with packages maintained by the manufacturer? If update goes wrong, it will be on support. They require almost no maintenance.
You would put two in different locations for redundancy and it begins to be a personal “cloud”.
Another option is an app like nextcloud. You learn it and it does everything 80% as good as possible, which is often more than enough!
Is it such crazy of an ask to have some it guys sell me the box already set up to be used as a self-host solution aio ? Why can't I find any company that sells this?
> Self-hosting is when you have a computer in your house do those same things
Self-hosting is more about deploying self-selected software onto a server. It can be a server at home, but I for one have a lot of services running on a VPS. Self-hosting is more about control of the data and software, than the location of the hardware.
> Well...since our friends can't access our server, the only good way to do that would probably be using an app like Google Photos or iCloud
Get a domain and set up a subdomain for Immich (maybe add a tunnel if it is a home server). I have friends using my Immich instance without problems, it's just another app.
> I'm talking publicly funded, accessible, at cost cloud-services.
I can't see how one can convince people to switch to a community cloud if Apple Cloud etc. exists. Most people just won't understand the difference or benefits.
Thanks for your comment! Yes, I ignored the VPS angle simply for ease of narrative, but you're right. I also updated the shared album example to hopefully better explain why this is hard from a technical and UX perspective.
As to the "convince people to switch" angle, I think the benefits of data interoperability would be pretty significant and eventually lead people to switch to providers that have that or would likely incentivize providers like Apple to implement that into their products.
Ideally, no one would have to switch and everything would just get better.
That all depends if you're willing to run stuff yourself, or be subservient on the good will of companies not to enshittify (pro-tip, they always will).
I'm running Immich, syncthing (watching about 2TB in 150,000 files), jellyfin, and pihole, as well as remoting in to a browser session, on this: https://www.amazon.com/dp/B0CH81C4K3 which is a $125 NUC with 8GB of RAM and an Intel N150. I know from experience that adding NextCloud to it would work out OK for a family, and I imagine you could shove most of the rest of that list on to this system as well, though in the case of ProxMox I'm just talking about the management. Obviously I'm not running very many full VMs on that before it runs out of RAM. (I don't even know if it can run VMs. Everything's docker in this setup.) The bottleneck appears to be RAM as that is eating about half of it right now. The CPU only works when someone is doing something, and there is some contention at startup as all of the services start scanning their storage for changes, but it gets through it.
jellyfin is configured to not transcode anything. The vast bulk of my library is DVD/BluRay rips of my own creation and I just ripped them in the desired format in the first place. This could probably keep up with a single DVD-quality re-encode, I dunno about Blu-Ray (depending on config, perhaps), but I just have it serve the correct files in the first place.
There's a ~$125 5TB USB drive hanging off of it for the media storage, which syncthing syncs to another 5TB drive in the house. (I don't actually "back up" my media storage in the full sense; everything else is actually backed up in the full sense to S3 via restic.) The "contention" I mentioned above is because all the big data sets are mostly on that spinning-rust drive.
The Immich AI features worked fine on this, though it did take overnight to process my initial load of ~20 years of photos. However once it chewed through that, the responsiveness is fantastic.
If you want responsive AI that uses GPUs this isn't anywhere near enough, but for any "conventional" app, $125 or $250 buys you a lot nowadays.
Chiming in to say I also run an n150 with mostly the same software. It does fine. Storage is 50tb of old server HDD so pretty cheap.
I ran an n100 until last week. Worked fine.
I have plex setup to transcode and it serves about 10 users just fine. My plexamp sonic analysis took like 4 days though, lol, but everyone says it takes forever.
My immich import took about 20 hours? So not bad.
I run all my home automation off it. 100+ devices, logging, etc. no issues.
I also sometimes run an OBS stream on it to transcode for YT. The n150 does fine.
Total cost for me is about $550. I saved a lot on HDD by going used server drives. $140 for the n150, $300 for drives, then a cheap UPS and router running openwrt.
As for difficulty, most of this is deployed in a few minutes using docker or install scripts. The hardest part is the choice between various solutions.
> Imagine a world where your library card includes 100GB of encrypted file storage, photo-sharing and document collaboration tools, and media streaming services — all for free.
But why should a (public) library be interested in providing such services? For funding? What about costs? On for example censorship/regulations/compliance/maintenance etc?
I'm not so sure a publicly funded library would have any interest in doing that. Think about it, if libraries can/welling to do any of that, then Amazon would never have any chance to grow this big.
I think that's why only private companies is capable of doing it, at least currently. They found out a way to make a profit while operating a sustainable (all things considered) cloud service.
In fact, the at-cost service provided by the libraries will probably collapse as soon as a for-profit company comes up with a cheaper plan.
Also, host by a library still creates centralized service, which comes with all problems that a centralized service inherits. It only shifts the problem, not solving it.
> But why should a (public) library be interested in providing such services? For funding? What about costs?
Public institutions like libraries are usually funded through government mandates. We as citizens decided that having free access to books is a good thing and nations, states, and municipalities dedicate tax dollars to fund those programs. So, if we decided providing internet-based services through the library was also important, we'd enact mandates for that, too.
Not saying that's likely, but it is possible.
> At-cost service[s] provided by the libraries will probably collapse as soon as a for-profit company comes up with a cheaper plan.
At-cost actually means it couldn't be cheaper (at least if economies of scale are equal). That gets a little hairy because companies like Google can provide services like Photos and Drive for "free" because they make so much money selling search data, but generally speaking that's the deal.
> Also, host by a library still creates centralized service, which comes with all problems that a centralized service inherits. It only shifts the problem, not solving it.
Totally agreed – if there was only one library. But, there are tons! And as I mentioned, if the services are based on interoperable standards, you could easily move your data between services and have them talk to each other so there's no vendor lock-in. Think ActivityPub for files.
Thanks again for reading and engaging in the discussion!
For example, it is possible for everyone to self-host their own service, it's true and everyone can do that right now. However, that's not what happened.
In reality, people oped in to use these cloud services, with full understanding of it's downsides, in exchange for convenience and low cost for themselves.
And as I've pointed out in my last comment, the companies has optimized their services so well, it made it very hard for a library, which is a "outsider" in the service field to compete. The library and it's lacking of technical know-hows, political resources etc will eventually doom the service, making it a product people only buy with higher-than-market price as a show off of their goodwell. That's not a sustainable business model or any model, really.
You must know all these things if you want to change the world for the better. Dreaming on vague an idea is easy, making things actually work is hard.
Also, you need to reconsider the meaning of the term "self-hosting", because unlike what people widely believed, "self-hosting" is not equivalent to "setup and running a server by yourself". The definition is much wider.
In fact, if you ever downloaded something from the Internet and storing it on your computer for later use, that's self-hosting, you just not sharing it with remote access. And if you copied what you've downloaded to multiple computers, then you've just created redundant and distributed backups.
But if you taking that into consideration, that downloading is self-hosting, then there's even less reason to use self-hosting service provided by a library, because why should you pay extra for all of that if you have already done it with no added cost? Just for a expensive remote backup maintained by people who has other jobs?
- "if there was only one library. But, there are tons!" - This is just empty dream. Not many will be welling to do it in reality.
- "if the services are based on interoperable standards" - Designing protocol is not easy, and by simply defining the protocol you also restricts what the protocol can do. A file sharing protocol? Good luck getting it to also do bookmark or chat. So, empty dream based on empty dreams?
Sigh. Have you noticed this many "IFs" in your idea? "If some public institution is welling to do it", "If the institution can handle all the requirements", "If regular people are welling to pay for it" etc etc. These ifs are much much bigger than what you probably expecting.
I do feel you have a good heart and wanted a good change, but you look inexperienced. I would recommend that you learn the industry or simply work in it for a few years, then maybe you'll come up with something that actually works.
There's Immich https://immich.app/ and https://ente.io/ which are both E2E encrypted and not locked to any ecosystem (besides, e.g. Apple only has E2E encryption when you have Advanced Data Protection enabled, and even then not on shared albums). So those apps are strictly an improvement (and I use them). I also do not have Facebook/Instagram/whatever else people are using that don't care about their own or related people's privacy.
You're almost there with your excellent lineup of self-hosted tech. Just throw in Headscale and some Tailscale clients and you'll be there. (Or any number of mesh VPN alternatives, like NetBird)
Could the friends access the server through the VPN?
> It's secured behind our own VPN.
> So, how do I create a shared photo album with my friends where we can all upload pictures from our latest trip? Well...since our friends can't access our server
I don't know if this idea was inspired by the Library Socialism movement or if it is an instance of "great minds think alike", but people who like this idea, may find Library Socialism appealing as well
I hope for a future where confidential computing or FHE tech is widely deployed (and cheap). Any computation can be done on any device without loosing confidentiality.
I hope for a future where confidential computing or FHE tech is widely deployed (and cheap). Any computation can be done on any device without loosing confidentiality.
It seems like the main benefit of self-hosting (and community-hosting) is “what if the bigco SAAS enshittifies”? i.e. it’s a backup plan.
What if instead, you just store local copies of your data, possibly organized and synchronized? If necessary it can be done manually, just download anything important enough that you might want it later. If a service decays, then import it into another.
A big point the author makes is that many cloud providers don’t let you download the data. But any media that can’t be accessed outside bigco’s cloud can’t be uploaded to your cloud in the first place. If bigco’s cloud prevents you from downloading data that you create or upload, only then the solution is to use a (possibly self-hosted) alternative. However, in practice I rarely see this happening, for example downloading from Google Workspace and OneDrive is very easy (it can even synchronize a folder on your local machine), and if you’re worried about it happening in the future, again, you can backup important files.
#LocalFirst baby! I agree that that would be ideal, but as someone who spent two days using Google Takeout to transfer 4 TB of photos from Google Photos to my server, even with easily downloadable file formats, they still make it a nightmare haha.
The reason why giving this storage and control over to any company doesn't work is because their incentives are always towards enshitiffication. The issue of community access can always be solved by self hosting on a rented cloud server, its still your data under your control its just someone elses box with a high speed internet connection and global accessibility, self hosting gives you the choice who sees and uses it and how. The hardware isn't actually the important bit, its the software.
I think its not the future in its current form either, because it requires too much configuration and maintenance for typical users, although NAS devices do it quite well and easily nowadays. But I also think that the cost of having Amazon et el do the maintenance has resulted in a lot of downtime that wipes out the internet every month or so for hours at a time and with the data theft and abuse and ever increasing profit extraction.
I honestly would be totally fine with large providers being the ones to host and "own" all my media---_if_ they were obsessive stewards of data quality.
To me it seems very reasonable to have these things hosted in central repositories, with large corporate stewards of the creative works, which I can access on any device for a monthly fee. The creators and owners of the works could then upgrade them over time, e.g. to newer formats or to fix errors.
But in practice, this isn't how it turns out:
* Tons of Kindle books have minor typos or OCR errors. These will never get fixed. If I had local copies, I could fix them... But nobody else would benefit from my fixes.
* Disney+ has misconfigured four episodes in Daredevil season 1 to show forced English subtitles for when English is on the screen---e.g. when there's an exit sign, there will be forced subtitles for "EXIT". I can only imagine if I submit some sort of ticket for this it'll just disappear into the ether.
* The Marvel Unlimited comic app, to their credit, is doing a great job digitizing their giant backlog. But they haven't paid a lot of attention to the flow of series, so e.g. "annual" issues are not slotted into the series they're part of. Back in the days when I collected cbz files, I painstakingly placed them all in sequence.
* Spotify's music metadata is pretty bad, and its collection is missing things like game soundtracks. (Although it has plenty of indy remixes of game soundtracks, clogging up the search results.)
* I worry that the "original quality" of all this media is getting lost over time. Certainly watching shows on Netflix is going to be lower quality on an absolute scale than Blu-ray rips, right? Similarly, comics are transmitted to my device as JPGs---I hope someone has the original, uncompressed pages stored somewhere.
If I had local copies of all this media, I could organize it beautifully, fix typos, set up perfect metadata/subtitles/etc. I used to do that, with pirated media, back in college. But it doesn't feel like a great use of time these days, mainly because nobody else will benefit from my obsessive work.
I wish the custodians of this media would care more about it, or put in place systems for community contributions to improve it. But the incentives are not there in terms of $$$, sadly.
> My wife and I now have a computer in our house that runs open-source equivalents to Google Drive, Google Photos, Audible, Kindle, and Netflix. It syncs to all of our devices. It's secured behind our own VPN. And it's wholly, truly owned by us.
Good for you. But for most people, it is an endeavor with zero gain, meaning no positive impact to their daily life, if not full of negative impact.
A danger with the arrangement of this article is that it takes awhile to get to the point, which actually in line with your view. He hints at it in the title and the very next paragraph, but maybe you didn’t get that far?
> And this week, I want to share with you how I did it, what I learned, and why I think self-hosting is NOT the future we should be fighting for.
While I know what you mean, money is one positive thing. The rest, you only realize the day google blocks your account because some stupid AI flagged a picture and they think you are a risk and kick you out.
Zero gain? Say that when your Google account is flagged because of any number of nonsense reasons. Or there's an issue that simply wipes your data from any number of services. Or a court requests access to your data and you have no idea.
You're leaving your entire digital existence up to companies who will and have ruined people's lives.
I think it says a lot about how much we've given up that control over your data and access to your data is seen as "zero gain" or "full of negative impact."
It's wild how little people care about their own rights. Capitalism and hustle culture make it so easy to give up so much while receiving so little in return. The pressure to give up more is constant and people willfully lean into it.
This is exactly what I’ve been building for a decade, but it’s not just a “community hosted cloud platform”, it is an entire reimagining of Facebook, Twitter, Reddit, LinkedIn, Telegram and all the other community platforms, for an open source world.
I have interviewed a lot of people on my channel, including founders of Freenet and MaidSAFE (now called Autonomi) which do in fact replace “the cloud” already, through entirely peer-to-peer nodes.
If anyone here knows Ted Nelson, please put us in touch! I would love to interview him about his vision for Xanadu
For my part, however, I am embracing a different model, where a “QBOX” black box would be hosted by our franchisees in the cloud, among other places. Placing the protocols inside the EC2 instances makes them untouchable by Amazon. Because AWS, Google et al legally are not allowed to go inside those boxes and mess with the software, or even read the contents of the RAM. And I don’t remember any story of them ever doing it even for the NSA. Do you?
Do you have links to stories of AWS breaking into EC2 instances to eg read RAM for data that is encrypted at rest?
And even if they do, this would present an issue for privacy, but the protocols would still enforce their own permissions (eg no custom amazon DRM for books).
Most of how the NSA operates is classified but this does not sound far-fetched to me in the slightest. Cloud providers frequently provide law enforcement information via subpoena. It's not really "breaking in."
> From the start of this calendar year through May, AWS received 813 subpoenas from the U.S. government seeking access to customer accounts. In those five months, the Seattle-based cloud provider fully complied with 542 of those court orders, submitted partial information in response to 126 and didn't respond at all to 145.
> Through the same period, Amazon received 25 search warrants from federal authorities and turned over all the data sought by about half of them, partially fulfilled eight others and withheld information requested by four of the warrants.
> AWS fully responded to only four out of 13 court orders that weren't subpoenas or warrants, while refusing to turn over any data related to four of those.
> Foreign governments were more successful with their solicitations to Amazon. Of the 132 non-U.S. requests fielded by the cloud provider, more than 80 percent yielded complete data disclosures, while just 13 percent hit a dead end. Amazon also complied with the only request it received during the five months under review to actually remove a user's data from its servers.
Alright mate, so for the 99.9% of cases encryption at rest is enough. For data you truly don’t want cloud providers to see, just use end-to-end encryption.
But no one has to run their own servers. The only reason I see them doing so is to provide redundancy in case the cloud providers want to DELETE some data or take nodes offline.
I agree with the title, but not the solution and that’s okay. Is the future endlessly tinkering with and running stuff out of your house? I think nope, that’s just your hobby.
I think of the centralization of content and the licensing as something that works so long as it’s a commodity market, that is, it’s hard to 2x the price of an ebook over a dead tree which I can own. Investors may wish otherwise, but they have to add tons of value to get consumers to play along.
I’m fine with commodities in my life. Power and water and gas come to mind. They cost what they cost and I don’t have problems with it.
I could build a nas and run software and admin it, or I could pay $20/mo to Adobe and another $33 to Apple for my family’s shared storage. Done. Of course, if the benefits of commoditization evaporate and it looks like the streaming market, then I’m wrong and would have to change track.
Couldn't agree more! And most of those commodities/utilities you mentioned are usually either publicly funded, cooperatively owned, or regulated to keep prices down and protect consumers
Will you clarify "centralization of content and the licensing"? Regarding DRM, specifically. If you own said content then sure, you can E2EE and store it in whatever cloud you prefer while avoiding common attention/control/data hoarding (read: enshittification) of commercial online cloud & online services. If you're saying DRM is OK then you're conflating commercial commodities with public utilities. The point of the former is to make money, the latter is to enrich our lives by taking care of basic human needs.
Centralized delivery of content licenses might be more accurate. Similar to your point about using public utilities as examples, I think it's a distinction without difference for what the OP was talking about.
I think the point is in a delivery of commodities (storage, IP licenses, water, power) there is some benefit from the generally fungible nature of the commodity, which makes it harder to put high prices on them, which makes doing it yourself more expensive and inefficient unless you value something very specific.
It's true I don't own the water from my city nor own access to it (it's a license, effectively), and I pay a delivery fee and purchase units of water. But like most people around, I don't value the intangible of truly owning access to the water under my land and drill a well, I just use the commodity. So it goes with e-book licensing and video licensing, too, and I don't think that they're regulated utilities affects this decision whatsoever - enough people value cost and convenience sufficiently to think licenses are fine for their use case instead of ownership.
>The point of the former is to make money, the latter is to enrich our lives by taking care of basic human needs.
The former could say they make money by enriching lives in their own way.
Is this arguing basic human needs should be charity? If so, even the most humble city will charge for water. Further, companies are often created to make money by providing production and distribution of that human need. Utilities are not altruistic but can be fair enough when held in check by a state.
The privileged enjoy far more privacy and autonomy and this is brought into sharp focus with wonderful hobbies like self-hosting. Perhaps it all boils down to end-stage capitalism, and perhaps there's a technical solution where selflessness overcomes end-stage capitalism. Someone else mentioned incentives and yeah, that'll help, but hopefully we'll collectively choose to do the hard thing because it's the right thing. Heck, maybe the right thing will also be the easy thing if we come up with better ideas like yours.
I really hate to pirate, but when publishers are in bed with scums like amazon and ignore these acts of greed, they might as well deal with piracy because we really need a tool to humble them
Well, my whole ebook collection sits on my computer and is managed via Calibre. I only buy books where I get a file without DRM. If there is DRM I don't buy.
My whole music collection sits on my computer in the form of well sorted mp3/flac/wav files. I buy only music where I get files or a physical carrier medium (Vinyl, Tapes, ...)
My whole movie/series collection sits on a jellfin server I can reach via wireguard from literally everywhere.
You get the idea. For me having the file and being able to scroll through my collection and decide what to pick from my collection is part of the fun. I am a musician myself and I earn more in a week in bandcamp (a few hundred bucks a year) than I would earn in 100 years on Spotify (60 cents a year), so if you wanna support the artists, doing it this way benefits them greatly.
It is nice that he created a cloud environment for a pointy/clicky people :)
But if I where to do such a thing:
1. Cloud only used to send and store locally encrypted compressed backup data
2. Open an ssh port to the public, but deny logins. Only allow logins using ssh keys.
3. Download data from my system using sftp/scp
This protects you from being chased by DRM lawyers because the system is not public. Plus it is very simple to setup.
Setting up a Cloud System like described here is very great for end users, but it could get you into court, or at the very least lots of take-down notices.
And the future isn't growing your own food at home. But we all know a garden in the yard is a wonderful thing and often better than what you can get at the store while being rewarding to tend.
There are two "futures" to disambiguate here. The future for for-profit and institutional entities, which is not self-hosted. And the future for human persons, which is. The former will probably be HTTP/3 (quic over UDP) exclusively with CA TLS required while the future for humans remains on HTTP+HTTPS HTTP/1.1.
I won't be too many more years before the corporate future completely divorces itself from the actual web and goes full HTTP-IS-JUST-A-TRANSPORT-FOR-JS-APPS and becomes unable to even visit normal websites. For "security" reasons, of course.
Eh, I can see your point. But Tailscale is a very different kind of centralized. It's just fancy, more convenient Wireguard at the end of the day. If I wanted to move away from it, it's pretty easy. Moving off of something like Google Photos however, was much harder in comparison.
Hosting without vendor lock-in is fine. However after a bit of thought, you'll realize that's the same thing as self-hosting. Self-hosting with an agent doing your hosting.
> Well...without exposing our services to the public internet and forcing our friends to signup for our weird app...
You do exactly that.
"Oh but security."
Any security you get from hiding behind a firewall is illusory at best. You still need to keep on top of updates and tech news. And I want to be able to access my stuff from wherever too.
Most of my friends don't have to, because they have me and at least 3 other friends who also self host.
There's a couple of things I won't let others in (like, my email domain. That's like my last name, so nope). But things like _sharing a video_? Yeah, I'll let them log in.
This article misses the point. The future will be self-hosted (or local community hosted) when automation technology actually matures and shows some real innovations.
plus it appears to be cyclical as we began with mainframes, then to pcs now back to the cloud, and given how arm is beginning to dominate i bet well see miniaturization push us back to local again
This article took a weird turn midway. I really enjoyed the beginning and the start.
My takeaway of the middle part is that the author had certain expectations about self hosting that weren't realistic and they jump to certain conclusions I would not have jumped to.
Yes it's true that we here are an extremely privileged bunch but over the decades I've seen tech become widely more accessible even before. People were paid a bunch of money just to write HTML in 1997 and in 2025 anyone can write a production ready website using the SOTA LLMs.
I am convinced the future is self-hosted (which is why I clicked on this link!) and as the cost of providing a service becomes less subsidized and starts to reflect the true cost to service a user, more and more people are going to self-host. From that lens, majority of the public not self-hosting is a cost-benefit, not a knowledge issue. Ergo, if tomorrow TikTok charged every person $500/mo, most people would figure out a way to run their own federated TikTok (but most likely just start using a similar but cheaper service).
Consider, there will be a future when Google will struggle to make money (gasp! how can that be?!) and many years before that day comes, all the "free" gmail accounts will be gone - because by then, email will cease to serve as a method for a company to mine novel information, I imagine there will be no "free" GMail although "free" email might still exist then just because the cost to provide 10GB email would be insignificant and worth good PR to someone (but at that point, not Google).
Translation: this particular user wants to make different privacy choices than the rest and pretends that we should philosophically follow.
All because Big Corp does anti open software/anti privacy thing.
Give me a break.
These platitudes ring like propaganda. I do what I want with my computer and data. You don't get to choose to "connect with me".
> Beyond individualism
To authoritarianism.
It's fine if the author wants to do all this but the kind of "we should all do X, which goes against your privacy/data/control beliefs because it's for our greater good" sounds so Rich CEO that knows better, kind of talk.
I think collective, democratic ownership is kind of the opposite of authoritarianism, right haha? But I agree choice is important! Thanks for your comment!
Is it just me or is the entire concept of "ownership" kind of wrong in the realm of digital (things that can be copy pasted infinitely and distributed mostly for free)?
Instead we should have ideas of AUTH, AUTH fraud (distributing content with wrong authorship), the right to generate revenue by distribution.
Restricting distribution of something that is essentially free to distribute feels wrong. If you tried to explain to aliens that you had solved "food" with a replicator but The Gov actually banned this and people had to starve ... you would likely be met with some questions.
During the Enlightenment, owning a physical copy of a book meant intellectual freedom. You didn’t rent ideas; you had them. Today, most digital knowledge is hosted, locked, or streamed — *leased from platforms*, not owned. We’re in fact drifting into *digital feudalism*, where access to culture, tools, and even history depends on gatekeepers.
In a perfect world this should go beyond market logic. It’s not just a question of what's sustainable or profitable. It's about *civic autonomy*. If the infrastructure of knowledge is centralized, then so is control over thought.
Self-hosting may not be for everyone, but *distributed, open systems are essential* to preserving a democratic and durable digital commons.
reply