Notices by Jason Scott (textfiles@digipres.club)

@sireebob @nightpool I'm vaguely interested in archiving.

There's something like 40 petabytes of data on there, give or take, and billions of stored websites and this means thousands of spinning disk drives and shooting out 11 petabytes of bandwidth a month (that's a real number) and an average of 3-5mil visitors daily. So a good amount of effort is spent just trying to ensure no meltdowns while surviving on a budget of $14m/year. And that $14m budget is EVERYTHING; hardware, salaries, supplies, etc.

Obviously, a lot of people want the Internet Archive to exist. They benefit from it, enjoy it, browse it from time to time, or get excited as things appear on it and get mentioned in the news. Millions of people a day. NO QUESTION it's one of the crown jewels of the Internet, something that is so base to its usefulness that people have assumed for years that it's a government-funded site and not one person's really intense dream.

Sure, let's do this.

I think folks sometimes forget the parties, forces and individuals who have started at the baseline of not even wanting the Internet Archive to exist. They have a dozen different reasons for it, and they are very emphatic, and they speak of the Archive with venom, "smh" and any of a spectrum of authority. So let's start there, right? Significant people who want it to die.

@kibi A classic example of the robots.txt being problematic - I'll bring it up with the Wayback team.