#1  
Old 14-05-2016, 12:54 PM
gregbradley's Avatar
gregbradley
Registered User

gregbradley is offline
 
Join Date: Feb 2006
Location: Sydney
Posts: 17,877
Removing a column defect in image processing

I have a camera which has a couple of minor columns that form a dark line vertically. These are quite common with CCD cameras.

I use CCDstack for calibration. Mostly these just dark subtract out but I am finding sometimes they persist.

Has anyone got some advice about best practice to remove these? CCDstack has a bad pixel map function which I used briefly yesterday and it did not seem very user friendly or effective.

Greg.
Reply With Quote
  #2  
Old 14-05-2016, 01:06 PM
multiweb's Avatar
multiweb (Marc)
ze frogginator

multiweb is offline
 
Join Date: Oct 2007
Location: Sydney
Posts: 22,060
Quote:
Originally Posted by gregbradley View Post
I have a camera which has a couple of minor columns that form a dark line vertically. These are quite common with CCD cameras.

I use CCDstack for calibration. Mostly these just dark subtract out but I am finding sometimes they persist.

Has anyone got some advice about best practice to remove these? CCDstack has a bad pixel map function which I used briefly yesterday and it did not seem very user friendly or effective.

Greg.
Hi Greg, are you using an OSC or mono? Process is a little different.

To make a bad pixel map in CCD Stack, load one sub, a 20min or longer exposure dark frame. Open the bad pixel map dialogue box, click on create map, then go to the reject range algo in the rejection standard drop down menu. Select a range to reject until you paint all the hot pixels and your column as well. When you're happy with the map, enter a name and save it. I usually use the name of the camera and a timestamp like <camera>_20160514 . To apply the map, load your sub then apply it. Tick the box to set the painted pixel to 0. Next step is to interpolate those pixels as they're all black in your sub. Then you're done. You might want to redo your map every 6 months or so, like your dark library. PixInsight has a cosmetic correction process that will do the same.
Reply With Quote
  #3  
Old 14-05-2016, 01:58 PM
Shiraz's Avatar
Shiraz (Ray)
Registered User

Shiraz is offline
 
Join Date: Apr 2010
Location: ardrossan south australia
Posts: 4,918
have a look at https://pixinsight.com/forum/index.php?topic=2869.0

I used to use Sander's software to clean up column issues with my QHY8 - from memory it worked well. Haven't used the PI script.

Last edited by Shiraz; 14-05-2016 at 07:53 PM.
Reply With Quote
  #4  
Old 14-05-2016, 02:23 PM
glend (Glen)
Registered User

glend is offline
 
Join Date: Jun 2013
Location: Lake Macquarie
Posts: 7,033
Seems too complicated in PI to me. My mono Canon has a bad pixel column, a bad row, and a bad hot pixel and DSS cleans it up perfectly. You need flats that show the bad column, and darks that show the hot pixel area, and other than that its just ticking the cosmetic cleaning you want DSS to do. It finds bad columns and rows automatically and replaces the bad pixel with an average of the ones on either side. If you dither between exposures it gets even easier. Anyone with sensor flaws should be dithering imho.
Reply With Quote
  #5  
Old 14-05-2016, 02:23 PM
DavidTrap's Avatar
DavidTrap (David)
Really just a beginner

DavidTrap is offline
 
Join Date: Jun 2009
Location: Brisbane
Posts: 3,032
PI cosmetic correction. You know you want to make the change Greg ;-)

DT
Reply With Quote
  #6  
Old 14-05-2016, 02:59 PM
DJT (David)
Registered User

DJT is offline
 
Join Date: Nov 2011
Location: Sydney
Posts: 1,452
+1 for using Pi. Takes a couple of mouse clicks then integrate with batch processing and you can save then reuse the process settings for future images.

Where's the emoticon for fan boy?
Reply With Quote
  #7  
Old 14-05-2016, 03:03 PM
RobF's Avatar
RobF (Rob)
Mostly harmless...

RobF is offline
 
Join Date: Jul 2008
Location: Brisbane, Australia
Posts: 5,716
Or just dither more, as I expect you're no doubt fully aware of for DSOs. Perhaps not so helpful for widefield/landscape of course.
Reply With Quote
  #8  
Old 14-05-2016, 07:37 PM
Peter Ward's Avatar
Peter Ward
Galaxy hitchhiking guide

Peter Ward is offline
 
Join Date: Dec 2007
Location: The Shire
Posts: 8,090
MaximCcd has an excellent bad pixel mapping and removal routine (from memory as sub function of its image calibration menu)

You can define partial or full rows or columns, as a numeric entry or simply by using the mouse cursor, as well as define hot or cold pixel cut-off's. While my current 16803 has no bad columns, there are some hot pixels which are non-linear that it cleans up in the blink of an eye.

Last edited by Peter Ward; 14-05-2016 at 07:45 PM. Reason: typo
Reply With Quote
  #9  
Old 14-05-2016, 08:28 PM
Eden's Avatar
Eden (Brett)
Registered Rambler

Eden is offline
 
Join Date: Jan 2014
Location: Melbourne, Australia
Posts: 399
Hi Greg,

If you don't mind me asking -- which camera is this? Is it a whole column defect or just partial?
Reply With Quote
  #10  
Old 15-05-2016, 07:57 PM
gregbradley's Avatar
gregbradley
Registered User

gregbradley is offline
 
Join Date: Feb 2006
Location: Sydney
Posts: 17,877
Quote:
Originally Posted by multiweb View Post
Hi Greg, are you using an OSC or mono? Process is a little different.

To make a bad pixel map in CCD Stack, load one sub, a 20min or longer exposure dark frame. Open the bad pixel map dialogue box, click on create map, then go to the reject range algo in the rejection standard drop down menu. Select a range to reject until you paint all the hot pixels and your column as well. When you're happy with the map, enter a name and save it. I usually use the name of the camera and a timestamp like <camera>_20160514 . To apply the map, load your sub then apply it. Tick the box to set the painted pixel to 0. Next step is to interpolate those pixels as they're all black in your sub. Then you're done. You might want to redo your map every 6 months or so, like your dark library. PixInsight has a cosmetic correction process that will do the same.
Thanks Marc. I will try your process. I did do most of those steps but not the check box to set the painted pixel to 0 so I got some dark rectangles where the correction took out too much.

Rick went over the cosmetic correction tool in PI so I may also try that if no luck with CCDstack.

Did you find you had to do a 20minute dark for it to work?

Quote:
Originally Posted by Shiraz View Post
have a look at https://pixinsight.com/forum/index.php?topic=2869.0

I used to use Sander's software to clean up column issues with my QHY8 - from memory it worked well. Haven't used the PI script.
I'll look that up. Is that the cosmetic correction script for PI?

Quote:
Originally Posted by glend View Post
Seems too complicated in PI to me. My mono Canon has a bad pixel column, a bad row, and a bad hot pixel and DSS cleans it up perfectly. You need flats that show the bad column, and darks that show the hot pixel area, and other than that its just ticking the cosmetic cleaning you want DSS to do. It finds bad columns and rows automatically and replaces the bad pixel with an average of the ones on either side. If you dither between exposures it gets even easier. Anyone with sensor flaws should be dithering imho.
Thanks for the tip.

Quote:
Originally Posted by DJT View Post
+1 for using Pi. Takes a couple of mouse clicks then integrate with batch processing and you can save then reuse the process settings for future images.

Where's the emoticon for fan boy?
Quote:
Originally Posted by DavidTrap View Post
PI cosmetic correction. You know you want to make the change Greg ;-)

Yes I already went to one of Rick's tutorials. I tried once since and no luck but I am sure I can get it to work. One issue was the lack of feedback on applying calibration. With CCDstack you see the result immediately.

DT
Quote:
Originally Posted by Peter Ward View Post
MaximCcd has an excellent bad pixel mapping and removal routine (from memory as sub function of its image calibration menu)

You can define partial or full rows or columns, as a numeric entry or simply by using the mouse cursor, as well as define hot or cold pixel cut-off's. While my current 16803 has no bad columns, there are some hot pixels which are non-linear that it cleans up in the blink of an eye.
Thanks Peter. So far I have not used Maxim. I still use CCDsoft or Sky X.

Quote:
Originally Posted by RobF View Post
Or just dither more, as I expect you're no doubt fully aware of for DSOs. Perhaps not so helpful for widefield/landscape of course.
Yes dithering is probably what changed. Although I found the lines vanished with regular darks. These were longer exposures and the darks don't match exactly for length.


Quote:
Originally Posted by Eden View Post
Hi Greg,

If you don't mind me asking -- which camera is this? Is it a whole column defect or just partial?
ST8300.

Greg.
Reply With Quote
  #11  
Old 16-05-2016, 08:46 AM
multiweb's Avatar
multiweb (Marc)
ze frogginator

multiweb is offline
 
Join Date: Oct 2007
Location: Sydney
Posts: 22,060
Quote:
Originally Posted by gregbradley View Post
Thanks Marc. I will try your process. I did do most of those steps but not the check box to set the painted pixel to 0 so I got some dark rectangles where the correction took out too much.?
The step to interpolate the missing pixels back with the neighbouring ones is the important one. Otherwise you end up with holes in your subs and they become lines after you've registered and stacked them so best to take care of all the cosmetics before debayering makes them bigger or registering makes them worse.
Reply With Quote
  #12  
Old 16-05-2016, 10:39 AM
gregbradley's Avatar
gregbradley
Registered User

gregbradley is offline
 
Join Date: Feb 2006
Location: Sydney
Posts: 17,877
Quote:
Originally Posted by multiweb View Post
The step to interpolate the missing pixels back with the neighbouring ones is the important one. Otherwise you end up with holes in your subs and they become lines after you've registered and stacked them so best to take care of all the cosmetics before debayering makes them bigger or registering makes them worse.

Thanks Marc.

I will be implementing this next I sit down to process the mountain of images I have at the moment.

I probably have 2 weeks solid processing's worth of data at present. So I want to get it all perfect and not have to redo stuff later.

Greg.
Reply With Quote
Reply

Bookmarks

Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +10. The time is now 07:34 AM.

Powered by vBulletin Version 3.8.7 | Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Advertisement
Testar
Advertisement
Bintel
Advertisement