#1  
Old 17-08-2020, 11:29 PM
Peter Ward's Avatar
Peter Ward
Galaxy hitchhiking guide

Peter Ward is offline
 
Join Date: Dec 2007
Location: The Shire
Posts: 8,106
Ripped Sol

It has been 9 years since I last updated my PC...but recent hardware failures and near data loss meant it was high time for an upgrade.

The new machine is a beast: based on an AMD Threadripper 3970x CPU

I re-processed some old data to give me a handle on real-world processing times.
This re-pro image was the result of a 600 frame, 16bit 6Mp .avi stack that used to take half an hour to process.

The Threadripper got it done in a mere 2 minutes.

It's Pixinsight benchmark was equally impressive at 20755.
While I've been putting off my solar imaging for a time due the endlessly long processing times caused by my newer 9.0Mp and 18Mp cameras
...this about to change.

Looks like Moore's law is still alive and well
Attached Thumbnails
Click for full-size image (Ripper.jpg)
199.9 KB127 views

Last edited by Peter Ward; 18-08-2020 at 01:31 PM. Reason: typo
Reply With Quote
  #2  
Old 18-08-2020, 10:06 AM
multiweb's Avatar
multiweb (Marc)
ze frogginator

multiweb is offline
 
Join Date: Oct 2007
Location: Sydney
Posts: 22,062
Awesome picture. So more solar imaging on the way for you now hey?
Reply With Quote
  #3  
Old 18-08-2020, 01:32 PM
Peter Ward's Avatar
Peter Ward
Galaxy hitchhiking guide

Peter Ward is offline
 
Join Date: Dec 2007
Location: The Shire
Posts: 8,106
Quote:
Originally Posted by multiweb View Post
............ So more solar imaging on the way for you now hey?
`That's the plan
Reply With Quote
  #4  
Old 18-08-2020, 03:32 PM
Atmos's Avatar
Atmos (Colin)
Ultimate Noob

Atmos is offline
 
Join Date: Aug 2011
Location: Melbourne
Posts: 6,982
That's some pretty good figures!
Puts my poor CPU to shame
Reply With Quote
  #5  
Old 18-08-2020, 04:01 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Peter,

FYI, you'll get even faster performance if you add one or more NVMe hard drives to your system and use them for PI swap files.

I've got a lesser Ryzen 9 3900X with 12 cores/24 threads and while my CPU is nowhere near your Threadripper in terms of PI benchmark, the overall performance is similar because my swap performance is 2.5 times better than your benchmark.

You don't need a large NVMe drive for swap - I've installed 2 x 250GB Samsung 970 EVO Plus drives. You will probably get a lot of the benefit from having one.

You've invested quite a bit in the CPU so it's a shame to hold it back by slow swap performance.



ps...nice SOL also!
Attached Thumbnails
Click for full-size image (200818.jpg)
95.8 KB41 views
Reply With Quote
  #6  
Old 18-08-2020, 08:58 PM
lazjen's Avatar
lazjen (Chris)
PI cult member

lazjen is offline
 
Join Date: Dec 2012
Location: Flaxton, Qld
Posts: 2,064
You'll also get a significant boost using Linux over Windows. A couple of years ago, I got the Threadripper 1950X which I assume is significantly less powerful than the 3970x. My PI benchmark was around 25 - 26000, while similarly specced systems running Windows struggled to get 18 - 19000.

I did fine tune my system for the benchmark, but a baseline linux setup was still in the low 20Ks.

Not much excuse to use Windows any more when the better option is Linux.
Reply With Quote
  #7  
Old 19-08-2020, 06:11 PM
Peter Ward's Avatar
Peter Ward
Galaxy hitchhiking guide

Peter Ward is offline
 
Join Date: Dec 2007
Location: The Shire
Posts: 8,106
Quote:
Originally Posted by peter_4059 View Post
Peter,

FYI, you'll get even faster performance if you add one or more NVMe hard drives to your system and use them for PI swap files.

I've got a lesser Ryzen 9 3900X with 12 cores/24 threads and while my CPU is nowhere near your Threadripper in terms of PI benchmark, the overall performance is similar because my swap performance is 2.5 times better than your benchmark.

You don't need a large NVMe drive for swap - I've installed 2 x 250GB Samsung 970 EVO Plus drives. You will probably get a lot of the benefit from having one.

You've invested quite a bit in the CPU so it's a shame to hold it back by slow swap performance.



ps...nice SOL also!
Interesting. I actually have 2 NVMe 2Tb Corsair drives and thanks to your heads-up , have now pointed the swap files to them. The performance certainly improved! ....but does not match the swap performance of your system. I guess the Samsung's are a faster drive.
Attached Thumbnails
Click for full-size image (Ripper2.jpg)
200.4 KB20 views
Reply With Quote
  #8  
Old 19-08-2020, 07:20 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
I think the transfer rate varies with drive size, even for the same brand. From my research 500 GB seemed to be the sweet spot. There are also a few generations of NVMe. Mine are gen 3 and you can now get gen 4.
Reply With Quote
  #9  
Old 19-08-2020, 09:21 PM
Peter Ward's Avatar
Peter Ward
Galaxy hitchhiking guide

Peter Ward is offline
 
Join Date: Dec 2007
Location: The Shire
Posts: 8,106
Quote:
Originally Posted by peter_4059 View Post
I think the transfer rate varies with drive size, even for the same brand. From my research 500 GB seemed to be the sweet spot. There are also a few generations of NVMe. Mine are gen 3 and you can now get gen 4.
Yep...I'm running Gen4.0

I did some tinkering and added in 2 extra swap file directories. While I fail to see how this can make a difference, it did! ....seems to peak out at 27K or so...as to the how/what/where/why ...a mystery to me.
Attached Thumbnails
Click for full-size image (Ripper3.jpg)
201.9 KB19 views
Reply With Quote
  #10  
Old 19-08-2020, 09:23 PM
Atmos's Avatar
Atmos (Colin)
Ultimate Noob

Atmos is offline
 
Join Date: Aug 2011
Location: Melbourne
Posts: 6,982
I've found that the optimum for my setup has been 4 swap files. Hasn't made any difference with more than four and there wasn't much of an increase from 2-3.
Reply With Quote
  #11  
Old 19-08-2020, 10:18 PM
lazjen's Avatar
lazjen (Chris)
PI cult member

lazjen is offline
 
Join Date: Dec 2012
Location: Flaxton, Qld
Posts: 2,064
It depends on the system setup. For mine, I found around 12 swap files was optimum after I ran some tests.
Reply With Quote
  #12  
Old 19-08-2020, 11:27 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
You've shaved 5.5 seconds off your original 22.7 seconds to complete the benchmark test. That seems like quite a nice improvement for zero cost. I found 8 swap files on each SSD - 16 in total gave the best benchmark result for my setup.
Reply With Quote
  #13  
Old 20-08-2020, 12:26 PM
Peter Ward's Avatar
Peter Ward
Galaxy hitchhiking guide

Peter Ward is offline
 
Join Date: Dec 2007
Location: The Shire
Posts: 8,106
Quote:
Originally Posted by peter_4059 View Post
You've shaved 5.5 seconds off your original 22.7 seconds to complete the benchmark test. That seems like quite a nice improvement for zero cost. I found 8 swap files on each SSD - 16 in total gave the best benchmark result for my setup.
Seems my system's optimum is 6 swap files per SSD. Results attached.
Attached Thumbnails
Click for full-size image (Ripper4.jpg)
192.9 KB19 views

Last edited by Peter Ward; 20-08-2020 at 01:54 PM.
Reply With Quote
  #14  
Old 20-08-2020, 01:51 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Reply With Quote
  #15  
Old 24-08-2020, 12:14 PM
Peter Ward's Avatar
Peter Ward
Galaxy hitchhiking guide

Peter Ward is offline
 
Join Date: Dec 2007
Location: The Shire
Posts: 8,106
Quote:
Originally Posted by lazjen View Post
You'll also get a significant boost using Linux over Windows. A couple of years ago, I got the Threadripper 1950X which I assume is significantly less powerful than the 3970x. My PI benchmark was around 25 - 26000, while similarly specced systems running Windows struggled to get 18 - 19000.

I did fine tune my system for the benchmark, but a baseline linux setup was still in the low 20Ks.

Not much excuse to use Windows any more when the better option is Linux.
Unfortunately there is an ocean of Windoze stuff I still need to run, so still pay Bill for his crappy OS.

I see what you mean with regard to Linux: the Pixinsight benchmark community has a 3970X running running LinuxOS at a whopping 43,847
Reply With Quote
  #16  
Old 24-08-2020, 02:47 PM
LewisM's Avatar
LewisM
Novichok test rabbit

LewisM is offline
 
Join Date: Aug 2012
Location: Somewhere in the cosmos...
Posts: 10,388
Meh... my 10 year old ASUS i7 with maxed out 8GB DDR3 RAM has a swap around 650

Given my paltry data, it’s done before yours even starts Peter
Reply With Quote
  #17  
Old 24-08-2020, 06:41 PM
DavidTrap's Avatar
DavidTrap (David)
Really just a beginner

DavidTrap is offline
 
Join Date: Jun 2009
Location: Brisbane
Posts: 3,032
Quote:
Originally Posted by Peter Ward View Post
Unfortunately there is an ocean of Windoze stuff I still need to run, so still pay Bill for his crappy OS.

I see what you mean with regard to Linux: the Pixinsight benchmark community has a 3970X running running LinuxOS at a whopping 43,847
Dual boot?

DT
Reply With Quote
  #18  
Old 24-08-2020, 06:43 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Quote:
Originally Posted by DavidTrap View Post
Dual boot?

DT
Or a second machine?
Reply With Quote
  #19  
Old 24-08-2020, 07:45 PM
DavidTrap's Avatar
DavidTrap (David)
Really just a beginner

DavidTrap is offline
 
Join Date: Jun 2009
Location: Brisbane
Posts: 3,032
Quote:
Originally Posted by peter_4059 View Post
Or a second machine?
That would be wasting valuable dollars that could be spent on Astro gear
Reply With Quote
Reply

Bookmarks

Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +10. The time is now 01:11 AM.

Powered by vBulletin Version 3.8.7 | Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Advertisement
Bintel
Advertisement
Testar
Advertisement