I used it on a long train trip. There was no internet due to drone attacks, and with Kiwix I could browse pre-downloaded Wikis
Maybe it's like linux distros: all based on the same software, but optimized for different use-cases or preferences.
An industrial grade Jetson Thor would probably be the ultimate platform for this if you ignore the money part.
If this project was actually serious about helping people in SHTF scenarios they would be building a neatly organized library of curated resources in a simple, easily parsed format indexed by some lightweight, local search engine. Who the fuck wants to fuck around with a convoluted docker setup just to browse their wikipedia dump? Local LLM? Are they fucking serious? Who would have the hardware and power to run this when the power grid goes down? This thing should be browsable with a file manager and hostable on a raspberry pi. Ideally it would be a zip file with documents and an executable that can be run on your local machine for search. The amount of unnecessary complexity here is ridiculous.
Also maps on a server? What's the point? If you're prepping you want those on paper.
whatever I think might be useful later, I capture through the web clipper extension. [0]
AlexNet -> Tansformers -> ChatGPT -> Claude Code -> Small LMs serving KBs
Large LLMs could have a role in efficiently producing such KBs.
Offline access and local models aren’t about assuming collapse—they’re about treating knowledge as infrastructure instead of something implicitly guaranteed.
That feels more like resilience than pessimism.
This isn’t prepping for anything it’s cosplaying as a vault dweller.
P.S. Having TED talks as part of the “educational” curriculum of this project is probably the biggest circle jerk imaginable.
One "popular" example for those whose horizon doesn't extend over US country borders:
"Hurricane Katrina devastated communications infrastructure across the Gulf Coast, incapacitating telephone service, police and fire dispatch centers, and emergency radio systems. Almost three million customer phone lines were knocked out, telephone switching centers were seriously damaged, and 1,477 cell towers were incapacitated. Most of the radio stations and many television stations in the New Orleans area were knocked off the air. Paul McHale, the Assistant Secretary of Defense for Homeland Defense, summarized the damage by stating, “The magnitude of the storm was such that the local communications system wasn’t simply degraded; it was, at least for a period of time, destroyed."
https://georgewbush-whitehouse.archives.gov/reports/katrina-...
"Our preparedness culture must also emphasize the importance of citizen and community preparedness. […] Thus, citizens and communities can help themselves by becoming more prepared. If every family maintained the resources to live in their homes without electricity and running water for three days, we could allocate more Federal, State, and local response resources to saving lives. Similarly, if every family developed their own emergency preparedness plan, they almost certainly would reduce the demand for outside emergency resources. As the 9/11 Commission Report states, “One clear lesson of September 11 is that individual civilians need to take responsibility for maximizing the probability that they will survive, should disaster strike."
https://georgewbush-whitehouse.archives.gov/reports/katrina-...
In the meanwhile, wikipedia ships wikidata, which uses RDF dumps (and probably 8x less compressed than it should be).
https://www.wikidata.org/wiki/Wikidata:Database_download
There is room for a third option leveraging commercial columnar database research.
For web content they recommend gzipped WARC. This is great for retaining the content, but isn’t easy to search or render.
I do WARC dumps then convert those to ZIM for easier access.
ZIM uses zstd so it is pretty compressed--but the thing that takes a lot of room is actually the full-text search index built in to each ZIM file.
Unfortunately the UI of kiwix-serve search doesn't take full advantage of this and the search experience kinda sucks...
Have you done anything useful with RDF? Seems like it is just one of those things universities spend money on and it doesn't really do anything
I do think having an LLM as an optional "sidecar" is a useful approach. If you can run a meaningful Ollama instance alongside your content, great!
The durable asset is the knowledge base itself. A local model can be useful on top, but it should stay a layer, not become the dependency.
I hope we can get to the point where even a small distilled model at the 7B-30B level avoids hallucinating.
>What is Project N.O.M.A.D.? Node for Offline Media, Archives, and Data
That's the first header, and the first sentence of the first paragraph, and I'm confused.
>Knowledge That Never Goes Offline
Means
>Knowledge That Never becomes inaccessible to you
While the next offline means you can access it even if you don't have access to a wider network.
At least that's how I would read it.
To "go offline" means for something to become inaccessible that was once accessible "online". ("Offline" is an adverb.)
Meanwhile, an "offline" thing is one which is usable even without ever being "online". ("Offline" is an adjective.)
So it becomes:
> "Knowledge That Never [Becomes Inaccessible]"
> "Node for [Accessible-Without-Connection] Media, Archives, and Data"
But definitely confusing to put them right next to each other like that. You'd think a copyeditor would flag it or something.
I was planning to build my own offline repository, but will check out this repo.
In the 1950s, US Civil Defense had a set of microfilms on how to rebuild society. These were packaged with a sunlight reader and stored in larger fallout shelters. Someone should find one of those.
For the margins a $280 MSRP allows you'd think they'd at least try a little bit: maybe hook people up with the RPi Compute Module which has eMMC onboard
FWIW, my pi-hole server has been running 24/7 on a Pi Zero with the same micro-SD card for some 4-odd years.
Moved to an Actual Computer with a M.2 SSD and zero issues since.
https://old.reddit.com/r/ARK/comments/p4xlpr/ark_is_over_200...
They mentioned it in their video: https://www.youtube.com/watch?v=P_wt-2P-WBk&t=350
While we're on that, for how long will water sources remain in liquid phase?
For anyone who never watched the original Soylent Green movie, it's worth a rewatch because it actually shows a future where people are having to make do without a power grid in cities, by doing things like riding a stationary bike hooked up to a generator to power their TV or radio long enough to get some news.
Think about all the ways you could die from nuclear war + winter. There's some worth avoiding(slow painful death from radiation, moderate burns, trapped in collapsed buildings, etc), and others that you might be willing to delay/prevent in a hope of things getting better(starvation, cancer, civil unrest, etc). There are ways you can reasonably prepare to increases your chances, if you're lucky in the critical moment of nukes dropping, to survive long enough to attempt forming communities and farming again.
I wouldn’t want to lose access to knowledge how to fix a sink or which medication is better, just because the local kingface currently feels that free exchange of opinions about him threatens his kingship.
OK steelmanning you, certainly a lot of them are way more interested in gun collecting and making beef jerky than other aspects.
[1] another example of a successful smear campaign
Both of which are available at Wal-Mart.
I always knew about the guns, but only recently discovered that Wal-Mart stores (at least in Louisiana) carry huge buckets with weeks worth of dehydrated survival food.
I'm sure it's for hurricanes. Yeah, that's it.
https://www.costco.com/p/-/mountain-house-1-year-emergency-f...
Sometimes they even appear in stores.
Apparently Mormons are required to keep some amount of emergency food on site.
Source: https://www.churchofjesuschrist.org/life/home-storage-center... (In older literature & analysis it used to be called the LDS Cannery or LDS Dry Cannery, but I guess they recently rebranded it.)
Take, for example, the 2018 California Camp Fire, the various southern winter flash power outages, or the endemic hurricane season pretty much everywhere exposed to the middle or southern pacific.
"For hurricanes" is a cute way to minimize it, but in much of the country it's rather little that separates you from being left to your own devices, at least for a little while, even when you're just suburban and haven't even looked out to the rural U.S.
There is a real deferred maintenance and resource mismanagement issue in this country. The increasing evidence of "preppers" and items like ration buckets becoming prevalent at bulk store operations like Walmart & Costco are early indications of the increasing prevalence of these issues.
Take a survey of the items that are always available at most Costos or Sam's Clubs across the country and you'll see similar results. They essentially market decentralized infrastructure for those that can afford it (or those who can't afford not to have it).
For me, it made a ton of sense to buy a couple of boxes of MREs and some Mountain House meals for this. They last decades, and they double as camping food.
Certainly some people probably emulate the Hollywood version, but I think that’s about it.
Most “peppers” are fathers that have had the good sense to pause and think “so, what would I be able to do to serve my family if something disastrous happened? What might that look like?”
Usually, a disaster go-bag of some kind with enough basic supplies to weather a day or two of displacement suspension of normal services. Sometimes, if they live in a place where it’s reasonable to imagine staying put is a good option, they might also have a generator and fuel, a week or two worth of long shelf life food, and some water storage. That ensures the wellbeing of their family will not be contingent on outside help, at least during most common disasters. Many of these people may also have a gun or two, for defense or for hunting if they are rural.
Some people go beyond that, and sometimes with a military focus, other times with months of rations, a bunker, or other unusual preparations. Mostly, those are not based on realistic scenarios. In almost any protracted disruption, having a lot of supplies , armaments, or resources will be as much a liability as an asset. People that buy guns -for prepping- are just living out some kind of hero fantasy. If you own guns, and use guns as part of your normal life, it would make sense to have a solid reserve of ammunition. If guns are your disaster scenario, you’re going to have a bad day.
As an individual or nuclear family, to weather an extended problem, you’d need to have a literal secret underground lair that was either so hard to get to or so well hidden that no one would know, and you’d have to be completely self contained. That’s simply not practical for all but actual billionaires, but people cosplay this to varying degrees. Even billionaires might find ymmv.
A much more practical and wholesome approach is to be part of a community that includes farming, independent sources of power and water, and generally sustainable independence from less robust centralized systems. This provides for basic necessities as well as a common defense. Humans lived in tribes for a reason, and 30 people with well aligned incentives and sustainable infrastructure for food, water, and energy is probably the absolute minimum viable structure for security during a disruption of more than a couple of months. Otherwise you would be dependant on total stealth or extreme isolation. Some neighbourhoods would probably coalesce into something resembling this, but organisation ad-hoc under pressure would probably end up with tensions if not violence.
Projects like this one can be real resources for well organized communities. I’ll probably look at running this on our servers as an additional resource, along with our library.
However, I think the derogatory prepper must exist in some number because you see so many products clearly targeting them. All the tacticool stuff, the buckets of dehydrated food, etc etc
As someone who lived through the "Snowpocalypse" in Texas in 2021, had no power for 11 days and no water service for 6 days, I was very thankful that I had a backup source of indoor heating, a couple of boxes of MREs, and clean water for a week as just part of having good disaster preparedness, as well as the mylar emergency blankets I hung by fishing line from my ceiling fans so to help create a warm space for my family. All that stuff is just part of a prudent approach to disaster preparedness that anyone who grew up in the middle of the country and has a house would do.
I know quite a few people who you'd write off as "preppers" that are not consumed with fantasies of a zombie apocalypse, but are instead wanting to ensure that their family is taken care of with basic necessities, vital medication, and a set of viable contingency plans when you lose power, water, etc for days or weeks.
Also, nobody but the very wealthy have "hundreds of guns". Guns are expensive. Guns hold their value. Guns are an asset in some communities. But they are expensive, and therefore even rather serious gun people have tens, but not hundreds. I'm probably more of a gun nut than the average, and I definitely do not have "hundreds of guns". To even store "hundreds of guns" safely (e.g. safe from theft, if not for other reasons) I'd need enough money to build a dedicated room in my house just to hold them. "hundreds of guns" is an armory, not a collection. I'm in the top 1% of wealth in my community in Texas and used to shoot competitively, so I'm more of "gun nut" than average, and I can't even imagine owning "hundreds of guns". That's such an outlandish fantasy strawman you have in your mind, it's nothing close to realistic.
You're really just smearing people with stereotypes in this thread that have no basis in reality, and it's clear you're completely unprepared for the reality of what life is like anywhere in the middle of America, much less in much of the rest of the world.
"We’re taking steps for survival for what we all know is coming. Today." I mean, come on.
Maybe I'm just beating around the bush too much - what I'm making fun of are people that are "prepping" for the end of the world. It is a silly (and strictly American, I imagine) fantasy to think that you're going to ride out the end of days sitting on a pile of guns and MREs. That is who I'm making fun of, and yes those people exist.
The lived reality of the "Snowpocalypse" says otherwise. "A functioning garden" doesn't produce food when it's 2F (-16C) outside and there is a foot and a half of snow on the ground. Beans and rice require soaking/washing and cooking at high temperature to be edible, dehydrated food does not.
I have beans and rice on hand always as well because they're staples in my diet, but it's ridiculous to consider them comparable in the situation where you don't have power (e.g. no way to heat food easily) and the weather makes the outside dangerous and not conducive to gardening/food production.
You're just doubling-down on a strawman, and it's frankly utter bullshit. Be better.
That said, I am convinced enough of the decay of western civilisation in general that I moved to a remote island nation and built a self contained off grid community, so I guess I am actually the extreme case of prepping. That’s certainly true, in a way, except it’s where my daily food, water, and power come from, and I am surrounded by a thriving community of family members and good friends. I honestly never thought I would see a cataclysm within my lifetime, so this was a legacy project for me, but it seems I may have been optimistic lol.
But I do agree with you that there are some nutty fruitcakes out there that are actually hoping for something bad to happen so that they can have their moment of glory, I suppose? It’s actually kinda sad.
I would say though it is uncharitable and even foolish to portray everyone who doesn’t have complete faith in the continuity of our Jenga Castle, especially in the context of recent events.
There are IMO a very small set of circumstances, out of many likely full collapse scenarios, where your average American (and make no mistake - I am specifically referring to Americans here) stockpiling junk is going to actually survive for very long.
This has nothing to do with faith in our society or institutions just that is uniquely American to think that you can buy your way out of any circumstance you can imagine.
What type of pepper are we talking about: piper or capsicum?
(I've also spent time living in legit BFE where the closest store for something can be more than an hour away, YMMV)
Burning Man isn't interesting because a bunch of individuals pitch tents in the desert, it's interesting because a society is built in the middle of the desert, spontaneously.
But the western Roman empire fell and cities depopulated and folks switched back to subsistence farming for hundreds of years.
And plenty of places have been at war and had much of civilization's usefulness diminished from days to decades. Not to mention straightforward natural disasters.
My prepping is limited to buying toilet paper at costco and having bags of beans and rice and such in my pantry and just... knowing how to do things in general.
> And plenty of places have been at war and had much of civilization's usefulness diminished from days to decades. Not to mention straightforward natural disasters.
The only one of those things someone survived by being an individual prepper is the natural disaster, because in the other cases the government didn't just go away, it was replaced by other groups who could kill any given individual and take their stuff. The only way to survive is to leave and become a refugee or to band together in an even bigger group that can kill all individuals and smaller groups and take all their stuff. This is how you get the Carolingian Empire, Los Zetas, MS-13, the Soviet Union, and the Khmer Rouge.
Individual preppers are living in a fantasy land to the extent they think they can wait out political collapse. They might well be competent enough to wait out a terrible natural disaster, but at that point they aren't "preppers" so much as people who listen to what FEMA and NOAA and other disaster-focused government agencies recommend for their regions.
You overestimate the importance of government and underestimate how it very much can just go away... and how distant it can be even when it exists, particularly historically. And how the local warlord equivalent isn't going around to everybody's house and murdering them.
And yeah in those times having food and a means of defense and whatever else is useful as often times very very many people had no option but to stay wherever they were. Famine and revolution are much more common and more mundane than you expect.
Prepper has become an umbrella term that is applied to a huge variety of people and mostly as a pejorative based on the sensationalization in media.
Many people that would be dismissed as preppers are perfectly normal people who approach the problem rationally. They take a layered approach which involves preparing for a range of timespans and events from the most basic like an extended power outage of 1 to 2 days or an unusually heavy snowstorm or minor flooding that may temporarily make roads impassible. Then escalating to natural disasters with week or monthlong power outage, gas and food shortages and damage to infrastructure. Personal disasters such as a housefire, flood or even financial difficulty from loss of job or health crisis. Then larger natural disasters like hurricanes, tornadoes, earthquakes and forest fires. Only after those are sufficiently covered would they consider more speculative events such as extended nationwide financial crisis, large regional disasters like a volcanic eruption, extreme earthquake, tsunami, major civil disruption, war, economic collapse, government coup, pandemic, etc.
What they do to prepare would include basic individual preparedness like having a generator and electrical hookup to power their home, extra water and food, essential everyday medications, alternate heat source, emergency radio, enough gasoline on hand for both the generator and vehicles and equipment like a chainsaw for clearing downed trees. Also vehicle packages or "go bags" with what you would need should you have to leave your house immediately during an evacuation or fire, if these are kept in the vehicle then they also help should you become stranded in your vehicle during a snowstorm or breakdown. They also prepare in their community often by simply having good relations with their neighbors and helping them when they're in need but may also volunteer with local emergency services or be involved in charitable groups or with likeminded people.
A lot of this has a long history in rural communities that required some level of self-sufficiency due to a lack of services, more precarious roads/powerlines and being low priority for aid during disasters.
FEMA's recommendations only address short term problems and evacuation. They're not sufficient for disruptions lasting longer than a week and the difficulties that people face in more rural areas during disasters.
I've personally been through events that have cut off grid power and transportation for my area for a few days as well as large widespread power outages lasting more than a week. When that happens you find out very quickly how important it is to prepare ahead of time.
Disasters are rare but not rare enough that you can be certain you'll never experience one first hand. "Collapse" events are very low probability, low enough that most people in the world won't likely experience one in their lifetimes but they do happen, you can probably name several countries that have recently been through such events due to war and many more that have been through them in the last 100 years. Many of us are lucky to live in very stable nations so you don't need to make those scenarios your number one priority but it's at least worth the effort to consider what you should do now to help yourself and your community to continue to thrive over the long term.
My grandmother and particularly great grandmothers prepared for winter... because it's a cold climate and grocery stores with the varieties they have are pretty new. So shelves in the basement full of canned goods they canned themselves, I remember making soap with my grandmother when I was a child... things like that.
For everyone it's this huge unreasonable hobby for me it's like well this is a bit of a return to a practice that was dying because of modern conveniences... but having a gun, a supply of water, a generator, and a full pantry in the rural midwest isn't exactly a radical concept.
That doesn't mean anybody who does a lot of research online or buys a lot of things is a obsessive hobbyist of course. The difference can at times be hard to tell from the outside, but someone whose first thought when an apocalypse brews on the horizon is to get weapons and turn their home into a bunker, instead of e.g. relying on a strong neighbourhood network and helping others is certainly a specific type of person. The problems that will arise are of the type that will be hard to solve alone. E.g. prep all you can, but what if your family member needs a doctor? Or something is fucked with your electrical system and you need someone.
This is why people make fun of preppers. Not because being prepared is a bad thing (it is not!), but because you get the feeling some of them can hardly wait for the end times to come around so they can test drive their gear.
Yet we still have arguably correct beliefs in spite of fallacies. That suggests that merely pattern matching isn't a good solution to detect what "truth" is...
I always just assumed that the all-around "prepper" framing was just the market gravitating towards people with cash!
In my conversations with neighbors, people understand preparedness for specific situations well. For example, disaster preparedness – "if the internet goes off, I'd like an LLM to tell me what the best way to stablize X medical emergency". Given the complete long-term erasure of Gaza's educational system, a lot of people also empathize with how useful educational resources would be for children.
In that context, I've assumed people just react against commercialism and the kitchen-sink paradigm of preparedness. (I certainly react against the first, but not the second... but then again I love playing the handyman even in times when things are going well.)
I remember when Russia invaded we were all supposed to freeze to death- in reality 2.5% of GDP was diverted and it was Bangladesh that didn't get their LNG tankers.
Full encyclopedia set, Merck Manual, home repair book, etc. May never use them, but I like having them.
Facebook ads even successfully targeted me for that “how to rebuild all of civilization” book. :)
Sounds like a good read.
So long as we don't forget that it's important to wash our hands and clean out wounds with soap, we're already centuries out of the middle ages.
Not impossible but I doubt we get another Industrial Revolution.
Well, we did it in an ice age the first time.
The demand a smaller civilization would have should be quite less significant than what we currently have, so it stands to reason it would make sense for them to use those
Interesting mental exercise. It was explored in A Canticle for Leibowitz[0], novel in 3 parts (Fiat homo, fiat lux, fiat voluntas tua), the first set in the immediate post nuclear-war world, second 600 years after towards the end of the new middle ages, and the third 600 later in a typical futuristic scenario. The first part covers the religious efforts to preserve knowledge (even if said knowledge was not understood), and the second in the new renaissance from wielding such knowledge.
I wonder how LLMs, with their mistakes and all, would play a role in rebuilding civilization. Most media these days is not prepared for staying stable for 20 years, not sure how much and for how long it could be preserved. Perhaps mechanical hard drives in certain isolated environments?
https://a.co/d/0ieNUmhB (Not a referral link)
It has everything from building houses to boats to making moonshine and medicine in it. Amazing stuff.
Why cringe at something people do privately in their own time that doesn't affect you? Why cringe at people who want to be prepared, even if you think their preparations are misplaced or nonsense? People deserve to be incorrect without being judged.
In reality far more important than most gear will be a good neighborhood network for example. But that means working on your own character.
If they'd be doing this in private, I couldn't care less. But in these cases, their actions would actively make my hobby less enjoyable, and I'll judge them for that.
Yes though watching that crowd is worthwhile. They often think about things different from mainstream and notice different things so good additional signal even if you ignore it
The doomsday preppers with a scarcity mindset and a bunker full of tin cans and military surplus make for good TV, but plenty of "preppers" don't look like that.
They also have a well-stocked pantry but focus more on strengthening the community to absorb shocks. Things like mutual aid networks, skill sharing, tool libraries, noodling with GMRS/HAM/LoRa comms, going on camping trips, helping each other out with kitchen gardens, and general community resilience. This approach doesn't cover every disaster scenario but it seems like a more pleasant (and realistic) option for the ones it does cover. And if nothing truly bad happens then at least they got to spend time doing things like gardening with their neighbors.
Being able to have offline Wikipedia, maps, and educational tools would be useful in either case but potentially even more so as a community resource because there are only so many skills each individual can learn.
And yeah, i have downloaded Wikipedia (in ZIM format) :-P
It isn't really for some doomsday preparation reason, it is just that sometimes the internet doesn't work (it doesn't happen often but it does happen) or i do not have internet access for whatever reason or stuff simply disappears/changes.
In fact just yesterday night i wanted to lookup how something is done in Bash and after trying to search for it, i noticed my Internet wasn't working (it took ~1h to resume, it was quite late in the night). So i just started a local LLM and asked that instead :-P (i do have the info manuals for bash - and other stuff - installed but they are a PITA to search if you don't know exactly what you're looking for).
One thing that annoys me though is that it is basically impossible to have an offline copy of a modern Linux distro. Sometime during the late 2000s i bought the full set of Debian DVDs, but Debian stopped providing ISOs years ago. Of course with how big distros are nowadays you'd probably need something like 100 DVDs :-P. At least there is Slackware.
I think it is still possible to use jigdo to make Bluray disks, but i do not have a bluray drive :-P
Not very usable to run current day stuff, but you have both netsurf, a video player, audio players, a PS/EPUB/PDF/image viewer, doc/xls readers to TXT (and converters) and Unix tools and games among 8/16 bit emulators.
With a bit of thinkering it can do a lot, look at the plan9 desktop page with 9front.
There's a Golang port too, and the AWK guide can be a godsend.
This is not for anuclear winter but maybe for an internet outage, which can be a real threat.
This is such a good idea. Thanks. I'm going to start to do the same.
> I keep a local wiki with notes on various things that are useful
Can you recommend a good wiki software?
I've been using Zim Wiki for years; back then there was nothing better available and now I can't be bothered to migrate formats. Plus I've already contributed a bunch of plugins to Zim :)
Mine contains language, library and game engine docs. Sometimes I back up some sites completely. But it's getting harder to do that as many sites block crawling now.
I'd love something like Kiwi designed to be like modern online-sharing software like Box etc where it just caches stuff until your drive is mostly full, deleting as necessary.
Thank you for sharing
- 200 line BASH script: https://github.com/Sub-SH/Beacon
- 17k lines of Ansible YAML https://github.com/iiab/iiab
What About Raspberry Pi?
Project NOMAD is designed for more capable hardware to support local AI.
If you're looking for a Raspberry Pi-based solution, check out Internet
in a Box — it's a great lightweight option for basic offline content.
Project NOMAD is for when you want the full experience: GPU-accelerated
AI, comprehensive content libraries, and a professional management
interface.
It's not the biggest deal if you're proficient in English, but I wasn't even able to download the full dump of English Wikipedia as their hardcoded link to it just seems to return 404.
The Docker setup leaves much to be desired, as network names are hardcoded, and extension services are expected to be reachable over hardcoded port numbers, making it impossible to run behind a reverse proxy.
Going to give this another go in a couple of years when it has had some more time in the oven, but it still looks very promising!
> "Military"-looking font
This is larping as a prepper, not anything more.
I mean look back at HN classic posts like the initial Dropbox announcement and the classic: this is nothing more than a wrapper over rsync, etc.
> > "Military"-looking font
> This is larping as a prepper
Preppers are often not "military"-type people, but rather distrusting of authorities (which is related to why the prep), including militaries.