0

My python program (single threaded) uses 59 seconds to process a file on my Mac Pro, and it's info is below:

MacBook Pro (15-inch, 2019)
2.4 GHz 8-Core Intel Core i9
16 GB 2400 MHz DDR4
Radeon Pro 560X 4 GB
Intel UHD Graphics 630 1536 MB

However, it takes 1.43 minute to process the same file on a server, which have multiple cores. The CentOs cpus is below:

# cat /proc/cpuinfo
processor   : 0
vendor_id   : GenuineIntel
cpu family  : 6
model       : 85
model name  : Intel(R) Xeon(R) Silver 4114 CPU @ 2.20GHz
stepping    : 4
microcode   : 0x1
cpu MHz     : 2200.002
cache size  : 14080 KB
physical id : 0
siblings    : 32
core id     : 0
cpu cores   : 16
apicid      : 0
initial apicid  : 0
fpu     : yes
fpu_exception   : yes
cpuid level : 13
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl eagerfpu pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap avx512cd avx512bw avx512vl xsaveopt xsavec xgetbv1
bogomips    : 4400.00
clflush size    : 64
cache_alignment : 64
address sizes   : 46 bits physical, 48 bits virtual
power management:

# free -mh 
              total        used        free      shared  buff/cache   available
Mem:           220G         26G         10G        1.2G        183G        191G

Each container probably has 2 cores with 8G memory each.

Does it make sense that the CentOs takes almost double time to complete the same task?

Improve this question
4
  • 1
    Your server’s CPU has lower single-threaded performance. Also, it may not even be the main reason. Unfortunately, you do not describe what your Python code does.
    – Daniel B
    Nov 24, 2020 at 23:52
  • 1
    The i9 is significantly faster than the Xeon, both from a base frequency perspective, but the boost frequency is nearly double that of the base frequency of the Xeon.
    – Ramhound
    Nov 24, 2020 at 23:56
  • Are you in a VM? Because the output of /proc/cpuinfo would suggest you only have a single thread available. If yes, then you may well be contending for CPU time with other virtual machines... consider also (as others have said) that the i9 is able to do significantly more work than the Xeon... CentOS won't likely be the "problem", the underlying system (and CPU) will be.
    – Attie
    Nov 25, 2020 at 0:25
  • Attie: It's a docker container environment.
    – martin
    Nov 25, 2020 at 0:27

1 Answer 1

Reset to default
0

This would not be an issue with CentOS.

We can only guess, but assuming that the CPU in your Macbook is the i9-9980HK (which I suspect is the case, that is a significantly faster CPU then the Silver 4114, and does it on fewer cores) I've built a comparison for you at https://www.cpubenchmark.net/compare/Intel-i9-9980HK-vs-Intel-Xeon-Silver-4114/3451vs3095 - Note the Single Thread rating of 2700 for the i9 vs 1651 for the Silver.

This explains most of the difference, with the rest possibly being down to code, cpu and program architecture and what else is running on the systems.

Improve this answer
2
  • what do you mean by 'This would not be an issue with CentOS'? You meant it should run almost the same speed as my Mac pro?
    – martin
    Nov 25, 2020 at 0:11
  • I mean that CentOS is not the reason the code runs slower. I posit that if you ran CentOS on the Macbook it would perform similarly to MacOS.
    – davidgo
    Nov 25, 2020 at 0:52

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.