549 reputation
36
bio website
location New Mexico
age
visits member for 4 years, 6 months
seen 23 hours ago

Jan
2
answered old hard drive failing and cannot access files
Dec
26
answered how to launch an sftp transfer via the console
Dec
26
comment How to count 900 million lines in a second
SSD's are really expensive per GB of storage and are more effective in a SAN environment where software tiering is active. A hypothetical 900 million line file with 128 byte records (avg) would use 11.5GB, and a 128GB OCZ Vertex 4 costs $US140 at newegg. Storing one file would use $12.57 of storage, filesystem overhead excluded. That is crazy. IMO - creating gigantic files is frequently ill-advised, a poor use of a resource, and is always expensive. An SSD would provide at least a factor of 10 speed up on a full file read.
Dec
26
comment How to count 900 million lines in a second
Take ~1500 lines starting from a truly random line, assuming the line length fits a normal distribution (which may not be a good assumption), then you have a 95% chance that the mean length of those lines represents the actual mean length. ~1500 would constitute statistically valid sample. So dividing (filesize /mean record length) would render pretty good estimate. This is way more trouble than wc -l. Your real problem is that your wc -l is I/O bound, and even with a 15000 rpm SATA drive or a really good SAN ~99% of elapsed time will be I/O wait.
Dec
26
comment how to launch an sftp transfer via the console
Good. Last question: Are ssh-keys installed on all three boxes? If yes it will make the mish-mash of an all ssh|tar transfer simpler.
Dec
25
comment Laptop having random and frequent slowdowns
What does the event log show from a previous time when there was a slowdown? That is probably the first place to look for errors.
Dec
24
comment how to launch an sftp transfer via the console
Please validate this: you want to move files on boxA to boxB, but you have to do that from boxC, correct? I assume you can login via ssh to any of the boxes, yes?
Dec
24
comment Bash profile shows “Unexpected End of File” error
what is the output of the following: source ~/.bashrc
Dec
16
answered Why is the setuid permission bit not set for mkdir in modern Unix systems?
Oct
17
comment syncing large files FreeBSD
You probably need SSD drives if this is actually the problem you make it out to be. Basically, from what you have said there IS no real solution to the wait. Now you indicate that your periodic sync slowed the process to disk I/O speeds, which has always been the case in the computer world. The answer is faster disk I/O, there is no other answer.
Oct
17
answered syncing large files FreeBSD
Oct
16
answered syncing large files FreeBSD
Feb
17
answered Linux find files
Jan
30
answered Crontab deleted?
Jan
23
answered unix - split a huge .gz file by line
Dec
20
answered Linux 'ls' - what does the * mean?
Nov
9
awarded  Commentator
Nov
9
comment trouble aliasing cd in bash
Just a note - FYI: . and .. are directory names. . == current directory .. == parent directory. Using them as aliases might cause a script somewhere heartburn.
Jul
3
awarded  Yearling
May
19
comment Wwhy do we need execution permission to change a directory in Unix?
+1 great answer