I have a git repository where I define the workflow (scripts + documentation) for setting up a database: from data download to data format to data publication.
As a result of the download stage, I have a set of (JSON) files summing up ~150MB (which I can compress to ~40MB tarball). Then those files move on the pipeline to eventually build a database collection.
Here is my question: I would like to include the result of the download stage together in my repository, but I don't need those data files to be versionized/controlled by git. In other words, I don't need Git to
diff those files whenever I update them in the future -- hopefully I will never use those files, but if I do I'll need only the latest version, don't care about their history.
Is that possible?
"Why I would want to do that?" -- Suppose the downloaded file(s) change completely from one commit to the other, the old version would stay in history using space for no reason since I only care for the latest version; that's why I took this route. Does that make sense?