Questions tagged [io]
IO or I/O is a common shorthand for referring to Input and Output
266
questions
1
vote
0
answers
577
views
Debugging IO saturation on linux
I have the following problem. On one machine, device IO is saturated to 100% util (via iostat -x 1) during one program execution. While on other less powerful CPU/GPU wise there's no such problem, ...
- 111
4
votes
2
answers
4k
views
Cloning disk without loss of information on IO errors
I want to test a partition creation software like parted.
I found an old USB stick which crashes the program whenever I try to read it. In order to preserve this test case I need to copy the USB ...
- 1,856
25
votes
2
answers
123k
views
Task Manager shows 100% disk usage at just 0.5Mbps
My PC shows 100% disk usage though Task Manager lists down only 0.4Mbps as the total usage and the PC freezes.
At other times, I can see disk I/O going upto 7 Mbps, but PC does not freeze.
I have ...
- 363
0
votes
1
answer
131
views
pata hard disk I/O error in 2 sectors
after deleting all partitions and creating one fat32 partition, I got this error in the terminal and then I ran GSmartControl and got a report.
and also the chkdsk gave me an error An error occurred ...
2
votes
1
answer
352
views
Unknown i/o port symbol on 15-pin D connector
I've never seen this symbol before, and can't seem to find it on the web.
The symbol appears to be an exclamation mark partly intersecting a horizontal (h axis longer than v axis) lozenge. I say "...
- 123
3
votes
1
answer
7k
views
ZFS vs raw disk for storing virtual machines: trade-offs
Background:
I am planning to set up a KVM to run Windows and Linux on the same workstation, and am undecided about how to set up the disks. It is my understanding that raw disks typically improve ...
- 328
0
votes
1
answer
89
views
What limits writing to 2 SSD drives at the same time
I'm trying to understand about IO and CPU cores and have gotten myself confused.
Does writing to 2 SSD drives depend on the number of cores? In my mind, if it's a single core process then the ...
- 1,933
1
vote
2
answers
2k
views
Does a x86 computer use the pci bus and pci protocols to access memory?
After viewing lspci -k:
00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor DRAM Controller (rev 06)
Subsystem: CLEVO/KAPOK Computer Device 5455
00:02.0 VGA compatible ...
- 178
0
votes
1
answer
48
views
Do random accesses wear hard disks?
For classical, old-style, non solid state hard disks (HDD), I know that random accesses are much slower than sequential accesses since the physical tip needs to jump from one point of the disk to ...
- 109
1
vote
0
answers
411
views
Flash drive works in read only, not on read/write [duplicate]
I have a 32GB Imation flash drive with a physical read-only switch.
A while ago I used it to install Ubuntu, and to do so I created a bootable USB. It worked, I installed Ubuntu, everything worked ...
- 121
6
votes
1
answer
2k
views
Windows: Determining which output stream # (1-9) console output is coming from?
I've seen questions in the past about "highlighting" different output streams between STDOUT and STDERR, but I was wondering if there was maybe a simpler way to do this on Windows.
The reason I ...
- 1,054
28
votes
3
answers
46k
views
Are there any Pros/Cons to the /j Robocopy option (unbuffered copying)
Robocopy has a /J command line option recommended for copying large files (it copies using unbuffered I/O).
What (if any) downsides are there?
Any reason this isn't enabled by default? (That's what ...
- 5,356
1
vote
1
answer
1k
views
Set disk I/O priorities in Win7 or only allow disk access to specific processes (via batch file)?
The former would be more elegant but the latter is also fine for my purposes (and probably the more errorproof solution).
I capture 720p50-HDTV losslessly (ULH0/ULH2) and my archive-drive is fast ...
- 21
2
votes
1
answer
2k
views
What does "% IO" mean in iotop?
I'm currently reading data from RAID and single hdd and monitoring speed with iotop. Numbers go like this:
RAID: 380MB/s 23% IO
HDD: 80MB/s 76% IO
How to interpret IO %?
- 810
0
votes
1
answer
98
views
Accumulate I/O for windows?
I have read about perfmon in Tracking disk I/O by application in Windows?
However, I am looking for something that doesn't show the current byte/s rates, but the total amount as if you were running ...
- 101
0
votes
0
answers
38
views
Follow up, extreme sluggishness on machine doing IO
This is a follow up to a previous question.
After more investigation it appears that I have a slightly different problem, whenever I do any volume of disk based activity like copying files or backing ...
- 181
4
votes
1
answer
2k
views
top equivalent to show I/O per process (per second) on mac/osx
Is there a top-like (visual) tool which can show per process disk I/O (kb/sec)?
The question was already asked at Monitor disk activity, á la top, or nettop (per process) on a Mac? and What'...
- 141
1
vote
1
answer
4k
views
Ubuntu not recognizing external hard drive
I have 2TB Wester Digital external hard drive. I connected it to USB 3.0 port on my laptop with Ubuntu 14.04 (64 bit) installed. It was working fine till yesterday (Haven't tried on any other OS). ...
- 11
1
vote
1
answer
652
views
Are Kernels hardware specific?
From my understanding, the Kernel provides the link between software and hardware, and therefore the Kernel must direct system calls being made by OS applications, correct? So would different I/O ...
- 113
-1
votes
1
answer
369
views
high priority for I/O operations
I came across this:
http://linux.die.net/man/1/ionice
however, it seems that it is not working on os x, as i got message that command not found.
is there any alternative to it or way to install ...
- 111
-1
votes
1
answer
155
views
provide mp4 file as camera input
Is it possible to have a pre-recorded video on a external storage unit and connect the storage unit as a camera and stream the pre-recorded video as output from the storage unit?
- 325
1
vote
1
answer
27k
views
Is there a way to limit buffer cache size in linux?
I've got program consuming a lot of memory during I/O operations, which is a side effect of performing loads of them. When I run program using direct_io the memory issue is gone but time it takes for ...
- 222
0
votes
3
answers
1k
views
I am confusing with the concepts: Input and Output devices
Concepts:
"An INPUT is data that a computer receives. An OUTPUT is data that a
computer sends." (Source: http://www.bbc.co.uk/)
For example I am going to work with a MOUSE (input device). I ...
- 513
0
votes
1
answer
58
views
Python logging output limited to ~65 lines
I am working on a simple python script on CentOS 7. There is an error, but I am trying to figure it out using the log.
I have a logging class that has the following logging levels:
Error
Warn
Degub
...
1
vote
1
answer
611
views
Benchmarking with Bonnie++
I need some help in interpreting this Bonnie++ results. These are the results from two VMs with Ubuntu 14.04 with identical hardware resources. One is running apache web server, other is running MySQL....
- 151
-1
votes
1
answer
87
views
why does asynchronous I/O require buffering?
I read in some introductory lecture notes on I/O and operating systems that "asynchronous systems require buffering". Why is it so please?
Cheers
- 103
0
votes
0
answers
133
views
java.exe heavy reading of symantec virus definition
I've noticed that a java application (IBM Webpsphere) is running slower than it used to be and doing a lot of IO. When I opened process monitor I saw a weird behavior: it was reading Symantec virus ...
- 393
0
votes
0
answers
56
views
Tool to connect to a file descriptor for I/O
I'm looking for a unix tool which can connect me to a specific file descriptor and do some I/O operations on it, assuming that the user permissions are valid. What could I look to use?
- 141
3
votes
0
answers
1k
views
Is there a way to get real time stdout and stderr from a process spawned by psexec on the same streams (pipes) as psexec
My question is very close to this question here with an additional constraint related to time-outs
I'm using Jenkins to start some automated testing and then to capture the stdout (and stderr) of the ...
- 191
0
votes
1
answer
37
views
Linux redirection pipe
I was testing out a kind of backwards indirection and came across this. I'm not specifying the desired behavior as there is none - I just want to understand the results - a sym link to an (unnamed?) ...
0
votes
0
answers
472
views
Debian freezes while intense SSD I/O
I bought an SSD drive (Kingston SSDNow) and installed Debian 8 on it;
The system works fine. But today I'm tried to extract a huge tar archive (~8GB) and in the middle of extraction the system just ...
- 1,179
0
votes
0
answers
2k
views
Input/output error when reading disk
I did a forced shutdown after my computer froze (on Ubuntu). After turning back on I found a "attempt to read or write outside of disk hd0" error, after choosing Ubuntu on GRUB.
I haven then ...
- 101
2
votes
2
answers
1k
views
How can I retrieve data from a SD Card when photorec doesn't work?
A friend of mine took pictures of a Halloween party with his camera, and when he put the SD card in his computer, some of the pictures went missing. Knowing that I have successfully rescued his HD ...
- 152
14
votes
2
answers
14k
views
How to monitor which files lots of data is being written to on Linux?
I can monitor I/O with tools such as iotop. It allows me to identify which processes do how much I/O.
Now I'd like to know which files those processes write all that data to. How would I do that?
E....
- 1,297
0
votes
1
answer
122
views
How to check what is causing performance issue
I have inherited a server with some performance issues. It is running node js, nginx, basic MEAN stack. (DB on another server though)
Whenever I copied a file (log file with size of around 150MB) or ...
- 511
0
votes
2
answers
204
views
Force a process in Windows 7 to store capture in RAM without doing actual I/O operation and writing to the disk
I'm Using Wireshark's cyclic buffers configuration capturing mode:
I am sniffing a 10Gig port, and I was expecting Wireshark to work cyclically with buffers on the DDR only, but apparently it doesn't....
- 322
0
votes
2
answers
261
views
How to catch hdd io killer process?
Sometimes my hdd on desktop PC starts work like crazy, then, in a short time all system starts to freeze, cursor barely moving, and then completely freezes, but hdd keep working non-stop.
I have no ...
- 167
2
votes
1
answer
30k
views
SVCHOST.EXE (LocalSystemNetworkRestricted) is using almost 100% disk usage?
I'm not running any other program, only Task Manager and Resource Monitor. It made my machine heavily non-responsive, even cursor sometimes jumps here and there and it's not accepting any keyboard ...
- 1,220
1
vote
2
answers
144
views
Would frequently reinstalling Linux distros affect the life of my hard disk?
I have Ubuntu and Fedora Linux distributions on my computer. I try to tweak many things in both of them and many times mess things up. So I normally reinstall the OS to fix it (as a last resort).
In ...
- 111
3
votes
0
answers
234
views
How to reduce I/O operations to a flash drive?
Background
I often use different computers, and for that reason I like to aways keep with me a flash drive with my home directory, with my bash aliases and helpful functions, vimrc, Homebrew ...
- 51
0
votes
0
answers
201
views
Bourne shell: how to add prefix string to stderr message?
I'm running a script on a Bourne shell, eg not bash (actually the sh from BusyBox 1.23.2).
As asked & answered in this question, I'd like to "catch" error messages issued by commands within my ...
- 101
1
vote
0
answers
282
views
Is I/O error sufficient reason to return SSD on warranty?
Several times I’ve encountered heavy disk errors leading to complete system crash, after reboot m/b doesn’t detect SSD till full PC poweroff.
Here is log I've managed to display before OS gone ...
- 810
1
vote
1
answer
974
views
Why is my System process doing disk IO?
Sometimes I want to see how much of my resources a program is actually using. But it seems that, often, even though the process is doing a lot it's for example hardly not doing any disk IO at all. The ...
- 39.6k
1
vote
0
answers
42
views
Determining average i/o file size on my computer
I'd like to see what the average data size is that my computer reads and writes to the hard drive. Many of the SSD benchmarks assume a 4K block of data, but what is my workload averages 16K? How ...
- 11
23
votes
1
answer
75k
views
diagnosing 100 percent disk usage in windows 10
Since updating to win 10, I'm experiencing issues with my disk usage. From time to time (sometimes every 10 minutes, sometimes once every few hours) my system becomes unresponsive because the disk ...
- 331
2
votes
1
answer
342
views
Consistent 100% disk access
I am a developer and on my work laptop it is entirely normal for my disk activity as shown by Task Manager to be 100%. With an average response between 7k-10k ms. This is under relatively simple ...
- 181
1
vote
0
answers
109
views
How can I use a Mirrorbow USB25IO board with a MacBook Pro?
I found an IO board in my closet, and I would like to use it with my MacBook pro.
The text on the board is "Mirrorbow Electronics USB IO V1.2"
I found this link to a manual:
http://homepage....
- 111
0
votes
1
answer
352
views
How to remove directory with error input i/o devive on hard disk
I have a hard disk with an error i/o.
This is caused in a folder which I needed to delete in order to restore things.
But deleting the folder gives the error. How can I force to delete this folder?
...
- 145
7
votes
1
answer
3k
views
Fail device in md RAID when ATA stops responding
I had created five 1TB HDD partitions (/dev/sda1, /dev/sdb1, /dev/sdc1, /dev/sde1, and /dev/sdf1) in a RAID 6 array called /dev/md0 using mdadm on Ubuntu 14.04 LTS Trusty Tahr.
The command sudo mdadm ...
- 19.6k
2
votes
1
answer
4k
views
Diagnosing disk i/o errors, failing disk controllers
My PC has been constantly crashing with disk i/o errors recently and I'm trying to diagnose what the cause is before I order any new parts.
I have windows 7 installed on a ssd (with truecrypt) and I ...
- 23