Topic: System Unresponsive During Long File Transfers and Processes

So -- during the process of backing up my old Linux Mint system, breaking up the .tar archive into eight 2GB pieces, moving it to my hard drive, then moving it to my fresh #! install and performing the reverse process to unpack everything, I noticed some extensive delays and unresponsiveness.

Specifically, during the process of transferring the split 2GB pieces of my .tar file, it took ages to open up Firefox, to the point at which I thought it wasn't going to work at all, then, finally, several minutes later, found about 20 instances of firefox opened simultaneously.  The strange thing about this was that the two cores of my dual core processor weren't terribly stressed out (10-15%), and the system load wasn't egregious either.  I experienced similar lag when i tried to concatenate the file pieces, but to a lesser extent, and even less so as i unpack the file (22%-35% usage of the cores).

I bring this up especially because I noticed more responsiveness on my Linux Mint system when running multiple processes like this, especially during the transfer of the files to/from my external hard drive.

It should also be noted that this occurred on my FIRST BOOT of the new #! system, which may have been responsible for some of the lag (with firefox creating new config files and so forth).

Re: System Unresponsive During Long File Transfers and Processes

Hmm, sounds like a fair amount of compressed data, although as you say, your cores were not overly stressed. This is the first time anyone has reported anything like this, so I would be hesitant to think it is the norm. Your report has been noted and I will keep watch for any feedback of a similar nature. When I get chance, I will also look on Launchpad for other reports.

How has the system been performing otherwise?

Re: System Unresponsive During Long File Transfers and Processes

That's the thing that's odd  -- the system performs phenominally when not conducting large file transfers and so forth, with apps and windows opening and closing instantaneously.  It's just when I'm trying to conduct normal browsing or terminal use while also performing these larger operations that I run into a problem.  I'll keep an eye out for similar behaviors and report my findings.

Re: System Unresponsive During Long File Transfers and Processes

Now that you say this, I had much the same happen when moving my backup (a folder with loads of subfolders and myriads of files, about 12 GB) from a USB drive onto the system. I don't think this happens in the terminal, does it? Could be a thunar issue....

Re: System Unresponsive During Long File Transfers and Processes

Now that you mention it, fabsh, the file transfers to/from my external HD were via Thunar -- and the .tar file concatenation/unpacking processes, which I reported as going much more smoothly, were done in the terminal.  Could Thunar be the culprit?  Maybe I'll install nautilus and test the same actions.

Re: System Unresponsive During Long File Transfers and Processes

Hi all,

I recently did a 7GB+ backup of #! to my USB external - using 8.04.02. Admittedly, they were many many small files, but went really fast, and without a hitch.

Re: System Unresponsive During Long File Transfers and Processes

Macmeister--

Thanks so much for providing the feedback.  If you're willing and/or daring enough to backup your system and load the new 8.10.01 #! as your primary OS, it might provide better insight into this idiosyncrasies of this particular version of the distro.  This seems like a select enough issue that it may be version- rather than distro-specific.

If you'd like a nice little script to help automate your backup process please let me know -- I've written a little script called backmeup that speeds up the backup process.

Re: System Unresponsive During Long File Transfers and Processes

I am running it fulltime. All in, so to speak. Will keep an eye on the issue...

Re: System Unresponsive During Long File Transfers and Processes

fabsh -- I'm also fulltime on #! -- the whole thing has been an unexpected renaissance for me.

Re: System Unresponsive During Long File Transfers and Processes

hey, i just noticed this today, I started transfering some movies, and the system slowed to a crawl sad when not transfering large files, the system flies..


also, does crunchbang utilize dual core processors by default? or do I have to enable it somehow?

Re: System Unresponsive During Long File Transfers and Processes

Mmmm, sounds like interrupt problems. Maybe it's kernel specific. That would explain how Mint is OK but #! is slow.

Like my machine,  Firewire and my Nvidia card on the same interrupt, so when i'm doing heavy firewire transfers I get all sorts of skipping and jumping. Put the output of /proc/interrupts onto pastebin so we can have a gander smile

[edit]

Also, check /proc/cpuinfo to see if #! is using both cores smile

Re: System Unresponsive During Long File Transfers and Processes

I have a eeepc 1000. Thought it had 2 cores in the processor. Yet the out put of

more /proc/interrupts

shows almost all the interupt load on CPU0.

will@kestrel-eee:~ $ sudo more /proc/interrupts
           CPU0       CPU1       
  0:     189076          0   IO-APIC-edge      timer
  1:        482          0   IO-APIC-edge      i8042
  8:        131          0   IO-APIC-edge      rtc0
  9:      21101          0   IO-APIC-fasteoi   acpi
 12:       2287          0   IO-APIC-edge      i8042
 14:          0          0   IO-APIC-edge      ata_piix
 15:      14022          0   IO-APIC-edge      ata_piix
 16:       1299          0   IO-APIC-fasteoi   uhci_hcd:usb4, HDA Intel, i915@pci:0000:00:02.
0
 18:          9          0   IO-APIC-fasteoi   uhci_hcd:usb3
 19:      56086          0   IO-APIC-fasteoi   uhci_hcd:usb2, ra0
 23:       3301          0   IO-APIC-fasteoi   uhci_hcd:usb1, ehci_hcd:usb5
219:          3          0   PCI-MSI-edge      eth0
NMI:          0          0   Non-maskable interrupts
LOC:     135372     211977   Local timer interrupts
RES:      18108      37289   Rescheduling interrupts
CAL:      46712     116980   function call interrupts
TLB:        622        701   TLB shootdowns
SPU:          0          0   Spurious interrupts
ERR:          0
MIS:          0

Does this seem normal?

My web activities: Twitter | Identi.ca | Facebook | Blog

Re: System Unresponsive During Long File Transfers and Processes

Ouch, you've got usb, audio, and graphics on one interrupt.

But yes, your right, it should balance more between the two cores. Check this out. may give you some handy hints to improve matters.

[edit]

Oh yes, looks like Ubuntu kernels have this issue by default.

CONFIG_ACPI_HOTPLUG_CPU=y

Re: System Unresponsive During Long File Transfers and Processes

Nik_Doof wrote:

Ouch, you've got usb, audio, and graphics on one interrupt.

But yes, your right, it should balance more between the two cores. Check this out. may give you some handy hints to improve matters.

[edit]

Oh yes, looks like Ubuntu kernels have this issue by default.

CONFIG_ACPI_HOTPLUG_CPU=y

According to http://www.alexandersandler.net/smp-aff … g-in-linux it appears that I have a kernel configuration problem.  Would explain some of the sluggishness I sense on my eee1000. I have installed crunchbang 8.10.1 and then updated to the array 2.6.27.8-eeepc kernel for wireless. All so to say stock. Nothing too weird. Others must be experiencing this too.

Well I guess I'm off to mod my own kernel. Wish me luck. Would I have had this problem using cruncheee?

My web activities: Twitter | Identi.ca | Facebook | Blog

Re: System Unresponsive During Long File Transfers and Processes

hey guys, im getting basically the same as Kestrel, all the load is on one cpu sad

~$ more /proc/interrupts
           CPU0       CPU1       
  0:     147690          0   IO-APIC-edge      timer
  8:         70          0   IO-APIC-edge      rtc0
  9:       6709          0   IO-APIC-fasteoi   acpi
 14:       7133          0   IO-APIC-edge      ata_piix
 15:          0          0   IO-APIC-edge      ata_piix
 16:        190          0   IO-APIC-fasteoi   uhci_hcd:usb4, fglrx[0]@PCI:1:0:0
 17:      64175          0   IO-APIC-fasteoi   ath
 18:         47          0   IO-APIC-fasteoi   uhci_hcd:usb3
 19:      15899          0   IO-APIC-fasteoi   uhci_hcd:usb2, ata_piix, ohci1394
 22:        429          0   IO-APIC-fasteoi   HDA Intel
 23:      47522          0   IO-APIC-fasteoi   uhci_hcd:usb1, ehci_hcd:usb5
219:       9959          0   PCI-MSI-edge      eth0
NMI:          0          0   Non-maskable interrupts
LOC:      33795     104398   Local timer interrupts
RES:      26422      46611   Rescheduling interrupts
CAL:      13953       6970   function call interrupts
TLB:       6430       2507   TLB shootdowns
SPU:          0          0   Spurious interrupts
ERR:          0
MIS:          0

I took a look at the link provided, and it looks like I have to install a new kernel?  how in the world do i do that without killing my #! install? or is there some easier solution?

Re: System Unresponsive During Long File Transfers and Processes

Also a quick note, Kernel devs have found the root cause of a bug causing crazy I/O wait:

http://bugzilla.kernel.org/show_bug.cgi?id=12309

Affects transfers between processes, not just disc. 2.6.17 and lower are not affected, is Mint on a old kernel?