#1  
Old 13-06-2020, 07:03 PM
alpal's Avatar
alpal
Registered User

alpal is offline
 
Join Date: Jan 2012
Location: Melbourne
Posts: 3,602
Sharpening worms.

Sharpening artifacts.

We often mention sharpening worms when discussing a pic and
I agree that it can look awful when the image is expanded to full size.
Most of the time we talk about such artifacts in areas of
highlighted details but they can appear in backgrounds.


CHART 32 - a very popular site with the best high res pics -
has someone called Bernd Flach-Wilken who has managed
to turn all the backgrounds into worms with bad processing.
When you go to "expand to actual size" you can see millions of them -

see here:
http://www.chart32.de/index.php/recent

NGC 4216-4206-422 Galaxies in Virgo
and here:
NGC6820-3 Nebula + Cluster.


Yet - the ones processed by Johannes Schedler have
beautiful backgrounds with no worms - example -

NGC7550 Galaxy Group.

I wonder if CHART32 know about it?
What is generally accepted now when doing sharpening?
Any comments?
I know that Mike sometimes mentions this subject.


cheers
Allan
Reply With Quote
  #2  
Old 13-06-2020, 07:12 PM
strongmanmike's Avatar
strongmanmike (Michael)
Highest Observatory in Oz

strongmanmike is offline
 
Join Date: May 2006
Location: Canberra
Posts: 17,150
Quote:
Originally Posted by alpal View Post
I know that Mike sometimes mentions this subject.
cheers
Allan
Noooo, never! .....

I'll wait before chiming in...I've said a bit on this topic in the past soooo, I'll wait a bit before commenting, interested to first hear/see what others think

Mike
Reply With Quote
  #3  
Old 13-06-2020, 09:36 PM
gregbradley's Avatar
gregbradley
Registered User

gregbradley is offline
 
Join Date: Feb 2006
Location: Sydney
Posts: 17,877
Sharpening is best achieved at the point of acquisition with good seeing, good focusing, adjustments for temperature for the focus.

Then in processing by removing subexposures with FWHM that is too large or star bloats from a passing thin cloud etc.

Sharpening also works best on images with strong signal to noise ratio so long enough exposure comes into it.

I find deconvolution is handy sometimes when the red or blue subs are bloated compared to the other colours and can get rid of unwanted blue or red rings around stars.

Multi scale decon can work if only in the bright areas of an image. Worms appear first in the weak signal areas of an image. So selective sharpening works best. High Pass filtering is fairly non destructive when masked in only on the detail areas.

Other than that I haven't found too much that works well for sharpening. It easily goes south and poor sharpening is the mark of an amateur.

Greg.
Reply With Quote
  #4  
Old 14-06-2020, 02:08 PM
alpal's Avatar
alpal
Registered User

alpal is offline
 
Join Date: Jan 2012
Location: Melbourne
Posts: 3,602
Quote:
Originally Posted by gregbradley View Post
Sharpening is best achieved at the point of acquisition with good seeing, good focusing, adjustments for temperature for the focus.

Then in processing by removing subexposures with FWHM that is too large or star bloats from a passing thin cloud etc.

Sharpening also works best on images with strong signal to noise ratio so long enough exposure comes into it.

I find deconvolution is handy sometimes when the red or blue subs are bloated compared to the other colours and can get rid of unwanted blue or red rings around stars.

Multi scale decon can work if only in the bright areas of an image. Worms appear first in the weak signal areas of an image. So selective sharpening works best. High Pass filtering is fairly non destructive when masked in only on the detail areas.

Other than that I haven't found too much that works well for sharpening. It easily goes south and poor sharpening is the mark of an amateur.

Greg.



Hi Greg & Mike,

I guess it's a matter of whether you want to show the full resolution picture
or a cut down small size version?
If you show full size after heavy sharpening then the worms will appear.
However there are many types of sharpening -
I like the one in Photoshop and the "smart sharpen" function.
I also have Fitswork4 which has:
Gaussian sharpening,
Iterative Gaussian sharpening,
Iterative PSF sharpening &
Deconvolution.


I find a mask is useful so that only areas of high signal strength are sharpened
otherwise the background will turn into blotches or worms
as per the example I have in the OP.


I have had interesting results using 3 x Drizzle in Deep Sky Stacker
on a small section of the picture.
That can bring out more detail when viewed at high resolution.



I don't think you can make everyone happy.
Sometimes I think that posters here need two pics full size -
one sharpened and one not?



cheers
Allan
Reply With Quote
  #5  
Old 14-06-2020, 04:18 PM
marc4darkskies's Avatar
marc4darkskies (Marcus)
Billions and Billions ...

marc4darkskies is offline
 
Join Date: Mar 2007
Location: Quialigo, NSW
Posts: 3,141
Interesting to see even the CHART32 team isn't immune to processing artefacts and the need for sharpening.

Anyway, it's quite a complex topic Allan, as I'm sure you know. If discussed thoroughly, it would cover a significant number of processing techniques. So here are just a few of my quick thought bubbles and comments:
  1. Worms are just enhanced noise - so don't sharpen your noise if you can avoid it!
  2. Worms are more commonly seen in background and low signal areas where they are very easy to create
  3. If you have noisy high signal areas - acquire more data!
  4. Deconvolution is your friend when your stars are over sampled and larger than you want. If stars are well sampled or under sampled I'd consider it a crime to use decon . Decon is also good for carefully and selectively sharpening nebulous detail in high signal areas.
  5. Decon readily produces enhanced noise artifacts (aka worms ) unless your low signal areas have very little noise to begin with ie: you have megadata or very low noise cameras etc. Note: If you overdo decon in high signal areas they can also develop worms.
  6. Various contrast / edge enhancing "sharpening" techniques and tools also produce noise artefacts - mostly ugly edge transistions and an "unnaturally" contrasty blobby look. Edge transitions in a good astro image should be smooth (mostly).
  7. Noise mitigation techniques and tools typically DON'T produce worms. It's more likely they'll produce mottling. However, severe and full frame contrast enhancement will make existing worms very visible.
In any case, and I can't stress this enough, appropriate masking becomes your best friend when dealing with noise and sharpening. Having said that, over sharpening high signal areas and then masking them off from the rest of the image can yield an obviously fake differentially sharpened look.

As to what is generally accepted, I'd say good sharpening should be gentle and not be noticeable at full res to anyone other than the author. Of course, pixel peeping will reveal even the most minor issues and is a disease that afflicts many of us! We should resist the urge to pixel peep other people's images.

I use a multitude of techniques to varying degrees:
  • Decon at the initial calibration stage (CCDStack decon is quite good). It invariably produces sharpened noise because I don't create mega-data. This is especially apparent in the background and low signal areas of galaxy shots - so I often stretch the unsharpened one and then overlay the sharpened stars and high signal areas over that with masking
  • Noise mitigation and background smoothing. Always with masking. PS Reduce Noise, Neat Image Reduce Noise, my own background flattening Actions for background blotchiness (Coarse, Medium and Fine)
  • Contrast enhancement. I use Unsharp masking (my own PS action), Smart Sharpen, recursive high pass filtering (my own PS action), Astra Image wavelet (sparingly), APF-R (Absolute Point of Focus developed by Christoph Kaltseis - my own PS action implementation) and micro curve adjustments

Cheers, Marcus
Reply With Quote
  #6  
Old 14-06-2020, 08:57 PM
alpal's Avatar
alpal
Registered User

alpal is offline
 
Join Date: Jan 2012
Location: Melbourne
Posts: 3,602
Good post Marcus - I agree with you.
It's amusing to know that even the processing Gods at CHART32
are not immune from the mistakes of mere mortals like us.


cheers
Allan
Reply With Quote
  #7  
Old 14-06-2020, 10:42 PM
strongmanmike's Avatar
strongmanmike (Michael)
Highest Observatory in Oz

strongmanmike is offline
 
Join Date: May 2006
Location: Canberra
Posts: 17,150
I think there might be different interpretations of what "worms" is referring too

The pseudo detail, or dots and worms, that I have been known to bang on about appear in the medium to high signal areas, where the filter used (decon/wavelets etc) compress any hint of feature or structure, into thin unnatural looking bright curves and wavy lines, or make all or much of the detail in galaxies, appear as uniform circular dots. Both artefacts give the impression of resolution, when viewed at small screen size, but even a half R'sed close inspection reveals the awful fake news ....provided the image posted is actually displayed at a reasonable size in order to be able to do this of course

The granular look seen in the low signal areas or the background, is a whole separate problem.

Mike
Reply With Quote
  #8  
Old 15-06-2020, 12:16 AM
that_guy's Avatar
that_guy (Tony)
Local Korean Millennial

that_guy is offline
 
Join Date: Dec 2009
Location: Charleville
Posts: 2,063
looks like they removed the image from the site.
Reply With Quote
  #9  
Old 15-06-2020, 12:16 AM
alpal's Avatar
alpal
Registered User

alpal is offline
 
Join Date: Jan 2012
Location: Melbourne
Posts: 3,602
Quote:
Originally Posted by strongmanmike View Post
I think there might be different interpretations of what "worms" is referring too

The pseudo detail, or dots and worms, that I have been known to bang on about appear in the medium to high signal areas, where the filter used (decon/wavelets etc) compress any hint of feature or structure, into thin unnatural looking bright curves and wavy lines, or make all or much of the detail in galaxies, appear as uniform circular dots. Both artefacts give the impression of resolution, when viewed at small screen size, but even a half R'sed close inspection reveals the awful fake news ....provided the image posted is actually displayed at a reasonable size in order to be able to do this of course

The granular look seen in the low signal areas or the background, is a whole separate problem.

Mike

Yes Mike,
I know what you mean - I've seen it as well in high signal areas.
Just to illustrate the point -
I have made a sample picture from a bee shot that I did in January
and posted in the Terrestrial section here in Ice in Space:
http://www.iceinspace.com.au/forum/s...d.php?t=180548


I show below 3 cropped versions to have a full 100% size comparison.
the first is the original - not sharpened,
the 2nd shows the image at 2 pixel smart sharpening which is from memory
what I used for the photo I posted.
The 3rd is one that I have deliberately over-sharpened in Fitswork4
at 4 pixels deconvolution to show what happens as a demonstration only.
I believe it shows the sharpening worms and dots that you're talking about?


cheers
Allan
Attached Thumbnails
Click for full-size image (Bee with different sharpening_small.jpg)
155.8 KB64 views
Reply With Quote
  #10  
Old 15-06-2020, 12:19 AM
alpal's Avatar
alpal
Registered User

alpal is offline
 
Join Date: Jan 2012
Location: Melbourne
Posts: 3,602
Quote:
Originally Posted by that_guy View Post
looks like they removed the image from the site.



No - it's still there just moved to the galaxies section:
http://www.chart32.de/galaxies-m

the latest one in recent has the same problem.
http://www.chart32.de/index.php/recent


NGC5101 Galaxy in Hydra




cheers
Allan
Reply With Quote
  #11  
Old 15-06-2020, 09:34 AM
marc4darkskies's Avatar
marc4darkskies (Marcus)
Billions and Billions ...

marc4darkskies is offline
 
Join Date: Mar 2007
Location: Quialigo, NSW
Posts: 3,141
Quote:
Originally Posted by strongmanmike View Post
I think there might be different interpretations of what "worms" is referring too

The pseudo detail, or dots and worms, that I have been known to bang on about appear in the medium to high signal areas, where the filter used (decon/wavelets etc) compress any hint of feature or structure, into thin unnatural looking bright curves and wavy lines, ...
Sorry Mike, my thought bubbles and comments didn't cover that - linear / crushed / merged detail in high signal areas. The worm-like artefacts I see and was mostly talking about are normally in low signal areas. See first example below.

The easiest way to reproduce the worms you're describing is using the minimum filter in PS (mainly used during star size reduction without masking) - see grossly exaggerated example below. I'm sure other software uses a similar mechanism.

Worms are NOT easily created using Wavelet sharpening - I've just tried and failed using gross Astra Image wavelet on a couple of my images. Decon and contrast enhancement can produce worm-like structures by virtue of the fact that they, when used in a ham fisted way, create bright blobs that may merge with other nearby bright areas to form a linear feature (per Allan's example).

Quote:
Originally Posted by strongmanmike View Post
... or make all or much of the detail in galaxies, appear as uniform circular dots
Nope, that's more likely gross noise mitigation via smoothing. Minimum filter can also do that.

Cheers, Marcus
Attached Thumbnails
Click for full-size image (Worms.jpg)
169.4 KB49 views
Click for full-size image (Worms2.jpg)
54.6 KB53 views
Reply With Quote
  #12  
Old 15-06-2020, 03:09 PM
strongmanmike's Avatar
strongmanmike (Michael)
Highest Observatory in Oz

strongmanmike is offline
 
Join Date: May 2006
Location: Canberra
Posts: 17,150
Yes I agree the Minimum filters can indeed produce a similar type effect but the worms and dots I have described are different again. I think there are quite a few different implementations of decon, wavelettes etc across different platforms that can produce different looking effects, hence the confusion?

Mike
Reply With Quote
  #13  
Old 15-06-2020, 03:34 PM
strongmanmike's Avatar
strongmanmike (Michael)
Highest Observatory in Oz

strongmanmike is offline
 
Join Date: May 2006
Location: Canberra
Posts: 17,150
Quote:
Originally Posted by alpal View Post
Yes Mike,
I know what you mean - I've seen it as well in high signal areas.
Just to illustrate the point -
I have made a sample picture from a bee shot that I did in January
and posted in the Terrestrial section here in Ice in Space:
http://www.iceinspace.com.au/forum/s...d.php?t=180548


I show below 3 cropped versions to have a full 100% size comparison.
the first is the original - not sharpened,
the 2nd shows the image at 2 pixel smart sharpening which is from memory
what I used for the photo I posted.
The 3rd is one that I have deliberately over-sharpened in Fitswork4
at 4 pixels deconvolution to show what happens as a demonstration only.
I believe it shows the sharpening worms and dots that you're talking about?


cheers
Allan
That effect in the third shot looks like typical decon artefacts to me Al with the characteristic ringing around bright bits..? As opposed to dots and worms.

Mike
Reply With Quote
  #14  
Old 15-06-2020, 04:33 PM
marc4darkskies's Avatar
marc4darkskies (Marcus)
Billions and Billions ...

marc4darkskies is offline
 
Join Date: Mar 2007
Location: Quialigo, NSW
Posts: 3,141
Quote:
Originally Posted by strongmanmike View Post
...but the worms and dots I have described are different again. I think there are quite a few different implementations of decon, wavelettes etc across different platforms that can produce different looking effects, hence the confusion?

Mike
Quote:
Originally Posted by strongmanmike View Post
That effect in the third shot looks like typical decon artefacts to me Al with the characteristic ringing around bright bits..? As opposed to dots and worms.Mike
Hmmm - In that case, why don't you show us exactly what you mean because I'm only being confused by what you're trying to describe. In all my experience, wavelets have never produced worms during my processing - just dots.

In the interest of getting to the bottom of this though, see below. Normal on the left and downright vicious (read ridiculous) wavelet with everything dialled up to 100 on the right.
Attached Thumbnails
Click for full-size image (HyperWavelet_Before.jpg)
50.5 KB62 views
Click for full-size image (HyperWavelet_After.jpg)
145.2 KB62 views
Reply With Quote
  #15  
Old 15-06-2020, 04:36 PM
codemonkey's Avatar
codemonkey (Lee)
Lee "Wormsy" Borsboom

codemonkey is offline
 
Join Date: Jul 2013
Location: Kilcoy, QLD
Posts: 2,058
Mike, just show 'em a crop of one of my images and be done with it lol
Reply With Quote
  #16  
Old 15-06-2020, 04:39 PM
gregbradley's Avatar
gregbradley
Registered User

gregbradley is offline
 
Join Date: Feb 2006
Location: Sydney
Posts: 17,877
Not entirely on-topic but somewhat relevant. The Fuji X series cameras with their 6 x 6 custom colour matrix (not Bayer) are renowned over the years for showing worms easily in their images. They are most common in foliage shots and show up easily in sharpening.

So perhaps resolution has a part to play in this as well. 6 x 6 would be lower resolution than your Bayer matrix of 2x2 pixels.

Greg.
Reply With Quote
  #17  
Old 15-06-2020, 04:51 PM
alpal's Avatar
alpal
Registered User

alpal is offline
 
Join Date: Jan 2012
Location: Melbourne
Posts: 3,602
Quote:
Originally Posted by codemonkey View Post
Mike, just show 'em a crop of one of my images and be done with it lol



To be scientific -

we would need to see an untouched pic & then the same pic sharpened.
Mike can't do that unless he used his own data.


cheers
Allan
Reply With Quote
  #18  
Old 15-06-2020, 05:06 PM
strongmanmike's Avatar
strongmanmike (Michael)
Highest Observatory in Oz

strongmanmike is offline
 
Join Date: May 2006
Location: Canberra
Posts: 17,150
Quote:
Originally Posted by codemonkey View Post
Mike, just show 'em a crop of one of my images and be done with it lol
well... I couldn't bring myself to use another persons image and say.. do a roll over or anything, just to try and prove a point ...you can post it if you like though ... but I'm not gunna do it man ...besides the effect is pretty muted in the odd image of yours when I maaaay have mentioned something I have seen muuuuch worse, where the image has been clearly interpreted as high res by a few viewers/commenters

Mike
Reply With Quote
  #19  
Old 15-06-2020, 06:09 PM
Camelopardalis's Avatar
Camelopardalis (Dunk)
Drifting from the pole

Camelopardalis is offline
 
Join Date: Feb 2013
Location: Brisbane
Posts: 5,425
Ahhh now we see who takes out the trash in this photo-mance
Reply With Quote
  #20  
Old 15-06-2020, 10:03 PM
strongmanmike's Avatar
strongmanmike (Michael)
Highest Observatory in Oz

strongmanmike is offline
 
Join Date: May 2006
Location: Canberra
Posts: 17,150
Quote:
Originally Posted by marc4darkskies View Post
Hmmm - In that case, why don't you show us exactly what you mean because I'm only being confused by what you're trying to describe. In all my experience, wavelets have never produced worms during my processing - just dots.

In the interest of getting to the bottom of this though, see below. Normal on the left and downright vicious (read ridiculous) wavelet with everything dialled up to 100 on the right.
Nice little bit of the Cats Paw there Marcus ...although the second image is ghastly and has worm like structures...it's still not what I am talking about though ...man, there are certainly many ways to ruin an image though, huh?

Mike
Reply With Quote
Reply

Bookmarks

Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +10. The time is now 05:24 AM.

Powered by vBulletin Version 3.8.7 | Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Advertisement
Bintel
Advertisement
Testar
Advertisement