How can I hash/checksum any sequential download, without having to store the whole file locally? It needs to work with any kind of sequential download, so "basic HTTP download" specific methods like httpdirfs, piping curl to hash untilities and python scripts using http + checksum libraries, aren't any good. It needs to work with file hosters that require an interactive browser session or propriety download software, for instance.
Maybe there is a FUSE filesystem (or similar) that will hash/checksum files put into it, but not actually store the files, but makes it appear to the program that is writing into the filesystem that the files are stored (assuming the programs don't try and read the file back)? Or maybe people can think of some other option(s)?
Simply writing to tmpfs wouldn't work as some files will be bigger than my available RAM.