I would like to split a large file (300GB), which is in my home
directory under the dev/sdb1
into two (or more) different parts and move them into two different disk drives. However, I would like my system to see the file as one.
To be more concrete I would like to split the file in two 150GB parts (or three 100GB, etc) and move those parts into different SSDs that I have. But, this file is used as an imput to a research project and I would like the system to see it as one. Additionally, I will need to specify its path in another file (a .prototxt
file where I specify all the inputs to my program) and that is the reason why I want to have one path under which the system recognizes that (splitted) file. Unfortunately, the SSDs are not huge enough to hold the whole file.
Additionaly, when I run df -h
the SSDs are show as:
Filesystem Mounted on
cluster-name-1-int:/var/tmp/local /import/cluster-name-1-int
cluster-name-2-int:/var/tmp/local /import/cluster-name-2-int
My system is in a cluster but I do not think that this will make any difference because I have access from the cluster-name-1
machine to the SSD on the others.Lastly, I do not have root access, so please tell me if your solution needs root privilages so that I would know and find a way to implement that solution.
EDIT: I provide as many information as I think would be useful. Use whatever you think might help towards a solution and any advice is welcome.
split
it, move and softlink the parts, and usecat soft_ln_DIR/all_soft_ln
as alternative and then pipe the output to the program?