Go Back   IceInSpace > Equipment > ATM and DIY Projects

Reply
 
Thread Tools Rate Thread
  #61  
Old 12-01-2020, 05:54 PM
troypiggo's Avatar
troypiggo (Troy)
Bust Duster

troypiggo is offline
 
Join Date: Nov 2008
Location: Brisbane, Australia
Posts: 4,846
Awesome work
Reply With Quote
  #62  
Old 12-01-2020, 08:03 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Quote:
Originally Posted by troypiggo View Post
Awesome work
Cheers Troy. I've now completed the bulk of what I was hoping to do with this. VB has provided a lot of extra flexibility that was difficult to do in Processing so it was worth the effort.

Here are my near final screen shots (all still using dummy random numbers for testing).
Attached Thumbnails
Click for full-size image (VB_S2.JPG)
32.9 KB66 views
Click for full-size image (VB_S3.JPG)
31.7 KB54 views
Click for full-size image (VB_S4.JPG)
29.2 KB48 views
Click for full-size image (VB_S5.JPG)
27.3 KB61 views

Last edited by peter_4059; 17-01-2020 at 09:05 PM.
Reply With Quote
  #63  
Old 13-01-2020, 08:57 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Put the finishing touches on this tonight. I've added the ability to log some basic data to a text file that will help me refine my cloud model. I've also compiled my first version into an exe file and it works
Attached Thumbnails
Click for full-size image (VB_S6.JPG)
29.5 KB46 views
Click for full-size image (VB_T1.JPG)
32.7 KB52 views
Reply With Quote
  #64  
Old 13-01-2020, 09:54 PM
RobF's Avatar
RobF (Rob)
Mostly harmless...

RobF is offline
 
Join Date: Jul 2008
Location: Brisbane, Australia
Posts: 5,716
Kudos again Peter for a great project.
I think you'd be well over Boltwood if charging labour by now?
Reply With Quote
  #65  
Old 14-01-2020, 09:38 AM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Quote:
Originally Posted by RobF View Post
Kudos again Peter for a great project.
I think you'd be well over Boltwood if charging labour by now?
Cheers Rob. That might be so however it was all about learning Arduino, Java and Visual Basic rather than trying to do it cheaper than a Boltwood. I also think this does a lot more than the Boltwood does.
Reply With Quote
  #66  
Old 14-01-2020, 07:50 PM
RobF's Avatar
RobF (Rob)
Mostly harmless...

RobF is offline
 
Join Date: Jul 2008
Location: Brisbane, Australia
Posts: 5,716
Quote:
Originally Posted by peter_4059 View Post
Cheers Rob. That might be so however it was all about learning Arduino, Java and Visual Basic rather than trying to do it cheaper than a Boltwood. I also think this does a lot more than the Boltwood does.
And you can improve it, repair it, etc as you need as time goes by
Reply With Quote
  #67  
Old 14-01-2020, 08:12 PM
ozstronomer's Avatar
ozstronomer (Geoff)
Registered User

ozstronomer is offline
 
Join Date: Jul 2007
Location: Brisbane
Posts: 964
Great project Peter, looks like you have come up with a really nice detector and comprehensive software to match.

Congrats on a job well done

Cheers Geoff
Reply With Quote
  #68  
Old 15-01-2020, 05:36 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Quote:
Originally Posted by ozstronomer View Post
Great project Peter, looks like you have come up with a really nice detector and comprehensive software to match.

Congrats on a job well done

Cheers Geoff
Thanks Geoff. Quite satisfying to see it all come together.
Reply With Quote
  #69  
Old 15-01-2020, 06:33 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Code now transferred to the observatory PC and all hooked up to the real sensors tonight. Log file and Obs Conditions text file both working as is connection to SGP Observing conditions.

Now I will focus on collecting data to refine the cloud model.
Attached Thumbnails
Click for full-size image (VBR1.JPG)
43.6 KB64 views
Click for full-size image (VBR2.JPG)
43.7 KB55 views
Click for full-size image (VBR3.JPG)
39.2 KB63 views
Click for full-size image (VBR4.JPG)
37.7 KB66 views
Click for full-size image (VBR5.JPG)
34.6 KB52 views
Click for full-size image (VBR7.JPG)
28.3 KB48 views

Last edited by peter_4059; 17-01-2020 at 09:07 PM.
Reply With Quote
  #70  
Old 15-01-2020, 08:29 PM
RobF's Avatar
RobF (Rob)
Mostly harmless...

RobF is offline
 
Join Date: Jul 2008
Location: Brisbane, Australia
Posts: 5,716
Should be plenty of cloud and rain to help refine that end of the spectrum over the next week....!
Reply With Quote
  #71  
Old 15-01-2020, 08:38 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Quote:
Originally Posted by RobF View Post
Should be plenty of cloud and rain to help refine that end of the spectrum over the next week....!
Yep - nearly got to try out the rain sensor tonight however the calibrated skin set off the alarm first.
Reply With Quote
  #72  
Old 27-02-2020, 10:25 AM
turbo_pascale's Avatar
turbo_pascale (Rob)
Registered User

turbo_pascale is offline
 
Join Date: Apr 2006
Location: Melbourne, Australia
Posts: 478
Hey Peter,

Where'd you get up to with this project?

I'm wanting to embark on a similar thing, as I need to automate more so I can get some sleep at night, and close the observatory if there is bad weather.

I'm looking to build something like yours, but you also changed a lot of things along the way. Have you "settled in" on the final hardware items?

Also, where did you find the boltwood one-liner specification?

I have a cheap-ish eBay weather station, and I think I can potentially use some of it's sensors (particularly wind speed and direction) to feed in.

Depending on the pricing of the parts though, it might end up cheaper to buy an AAG device. Not sure yet!
Reply With Quote
  #73  
Old 27-02-2020, 02:48 PM
turbo_pascale's Avatar
turbo_pascale (Rob)
Registered User

turbo_pascale is offline
 
Join Date: Apr 2006
Location: Melbourne, Australia
Posts: 478
Answered one of my own questions.
Was able to find a manual for the boltwood with both their old and new format.

http://song.phys.au.dk/hardware_manu...wood_cloud.pdf
Reply With Quote
  #74  
Old 27-02-2020, 06:52 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Hi Rob,

I've stopped adding hardware and completed my coding on this project for now. I'm now focusing on collecting data to see if I can improve my cloud model further.

The document you found on the Boltwood device shows the format for the one-line file. The column positions and number formatting are important for the ascom driver to work properly. There is some test apps included with the ascom driver that create a dummy file that you can use to see the actual format of the data.

In terms of hardware items I'd suggest with the benefit of hindsight, the MLX is definitely needed. That sensor has ambient and sky temperature outputs and that is sufficient to replicate the Boltwood methodology (this is also described in that PDF you found).

I was trying to improve the prediction of cloud as I observed simple temperature difference was not particularly accurate. My model needs relative humidity in addition to sky and ambient temperature. I'd recommend bypassing the DHT for humidity as they don't have a great reputation and go for a better sensor. I went for an Adafruit SHT31.

If you want light sensing, I'd go straight for something like the TSL2591 as the LDR was much too insensitive apart from detecting daylight vs night.

If you want more info on my approach, I'd be happy to share what I've done.

I've included a couple of plots below. The first one is ambient-sky temp vs observed cloud fraction. This is the Boltwood approach. You select two deltaT's - one for clear and one for partially cloudy. Based on my observations they would be -18 degC and -11 degC. The problem with this approach is there are plenty of data points where the deltaT would suggest there is cloud when in reality it appeared to be clear.

The second plot is my current model of observed cloud vs predicted cloud. Again not perfect but I'm still collecting a data set and each iteration is improving my R^2.

Cheers,

Peter
Attached Thumbnails
Click for full-size image (BoltwoodData.JPG)
26.9 KB38 views
Click for full-size image (CloudModelNow.JPG)
21.5 KB44 views
Reply With Quote
  #75  
Old 27-02-2020, 09:12 PM
turbo_pascale's Avatar
turbo_pascale (Rob)
Registered User

turbo_pascale is offline
 
Join Date: Apr 2006
Location: Melbourne, Australia
Posts: 478
Peter,

Thanks for all the feedback. I’ll start collating the parts list and see how far I get.

Your last point interests me. How are you correlating the cloud cover (actual) vs readings? By visual observation?

Have you thought of doing a correlated image acquisition analysis from a camera and the readings from the sensor? I’d be interested to see the specs on the FOV of the sky sensor and see if it could be mapped to an image taken at the same time.

Rob
Reply With Quote
  #76  
Old 27-02-2020, 09:25 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Quote:
Originally Posted by turbo_pascale View Post
Peter,

Thanks for all the feedback. I’ll start collating the parts list and see how far I get.

Your last point interests me. How are you correlating the cloud cover (actual) vs readings? By visual observation?

Have you thought of doing a correlated image acquisition analysis from a camera and the readings from the sensor? I’d be interested to see the specs on the FOV of the sky sensor and see if it could be mapped to an image taken at the same time.

Rob
Rob,

I'm using visual feedback to collect the actual cloud cover. I've built a data logging function in my app to collect the raw model input parameters from the sensors together with a manual cloud cover input and write that to a CSV file. The actual model development is in Excel.

Cloud cover percentage is a bit subjective visually and I assume this would also be a challenge using a camera image.

The IR sky temperature sensor that I'm using is a Jaycar XC-3704. You can download the datasheet from their webpage link:

https://www.jaycar.com.au/non-contac...odule/p/XC3704.

The packaging says it has a +/- 40 deg FOV.
Attached Thumbnails
Click for full-size image (VBR4.JPG)
37.7 KB33 views
Reply With Quote
  #77  
Old 01-03-2020, 09:36 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
I've been getting the occasional error in my VB version of this project. The exception text says:

************** Exception Text **************
System.InvalidOperationException: Collection was modified; enumeration operation may not execute.
at System.ThrowHelper.ThrowInvalidOper ationException(ExceptionResource resource)
at System.Collections.Generic.List`1.E numerator.MoveNextRare()
at System.Collections.Generic.List`1.E numerator.MoveNext()
at System.Windows.Forms.DataVisualizat ion.Charting.ChartTypes.LineChart.P rocessChartType(Boolean selection, ChartGraphics graph, CommonElements common, ChartArea area, Series seriesToDraw)
at System.Windows.Forms.DataVisualizat ion.Charting.ChartTypes.LineChart.P aint(ChartGraphics graph, CommonElements common, ChartArea area, Series seriesToDraw)
at System.Windows.Forms.DataVisualizat ion.Charting.ChartArea.Paint(ChartG raphics graph)
at System.Windows.Forms.DataVisualizat ion.Charting.ChartPicture.Paint(Gra phics graph, Boolean paintTopLevelElementOnly)
at System.Windows.Forms.DataVisualizat ion.Charting.Chart.OnPaint(PaintEve ntArgs e)
at System.Windows.Forms.Control.PaintW ithErrorHandling(PaintEventArgs e, Int16 layer)
at System.Windows.Forms.Control.WmPain t(Message& m)
at System.Windows.Forms.Control.WndPro c(Message& m)
at System.Windows.Forms.Control.Contro lNativeWindow.OnMessage(Message& m)
at System.Windows.Forms.Control.Contro lNativeWindow.WndProc(Message& m)
at System.Windows.Forms.NativeWindow.C allback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam)


Just wondering if anyone has experience that could lead me to a quick resolution?
Reply With Quote
  #78  
Old 01-03-2020, 10:07 PM
RobF's Avatar
RobF (Rob)
Mostly harmless...

RobF is offline
 
Join Date: Jul 2008
Location: Brisbane, Australia
Posts: 5,716
Don't know if this helps at all?
Rare interaction of threads affecting writing/reading object collection?

https://social.msdn.microsoft.com/Fo...=MSWinWebChart
Reply With Quote
  #79  
Old 07-03-2020, 09:51 AM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
Quote:
Originally Posted by RobF View Post
Don't know if this helps at all?
Rare interaction of threads affecting writing/reading object collection?

https://social.msdn.microsoft.com/Fo...=MSWinWebChart
Hi Rob,

I had seen that thread before and I suspect that is the cause of the problem however everything I've tried to do to fix that problem so far has not worked. I've decided to start a new thread in the software and computers forum to see if anyone with more programming experience will chime in.

Cheers,

Peter
Reply With Quote
  #80  
Old 10-03-2020, 10:48 PM
peter_4059's Avatar
peter_4059 (Peter)
Big Scopes are Cool

peter_4059 is offline
 
Join Date: Jun 2007
Location: SE Tasmania
Posts: 4,532
I'm calling a major breakthrough on this project. Raki has come to the rescue with some thread-safe VB code that has addressed the chart update error and has also allowed me to modify other parts of the code that were a bit sus so now it is working without obvious dodgy workarounds.

I must admit I'm pretty satisfied with the project and I've learned a lot about Arduinos, Java and VB.net.

Still more work to do on the cloud model but that will be something I'll do over 12 months.

Happy to share if anyone is interested in building their own cloud detector/weather station.
Reply With Quote
Reply

Bookmarks

Thread Tools
Rate This Thread
Rate This Thread:

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump


All times are GMT +10. The time is now 11:55 PM.

Powered by vBulletin Version 3.8.7 | Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Advertisement
Bintel
Advertisement
Testar
Advertisement