I've been trying use the stand alone transform applier but I get error messages as follows -
#TYPE=Extended
#OBSCODE=1234
#SOFTWARE=MaxIm DL Version 6.26
#DELIM=,
#DATE=JD
#OBSTYPE=DSLR
#NAME,DATE,MAG,MAGERR,FILTER,TRANS,MTYPE,CNAME,CMAG,KNAME,KMAG,AIRMASS,GROUP,CHART,NOTES
000-BNX-362,2459314.4119560183,12.921,0.003,B,NO,STD,000-BNX-358,18.455,na,na,na,na,X26445IC,na
# failed VSP API chart request. No CREFMAG available. Possibly bad chart reference. failed VSP API chart request. No KREFMAG available. Possibly bad chart reference. failed VSX request. target not in VSX.
000-BNX-362,2459314.4119560183,12.297,0.003,V,NO,STD,000-BNX-358,18.203,na,na,na,na,X26445IC,na
# failed VSP API chart request. No CREFMAG available. Possibly bad chart reference. failed VSP API chart request. No KREFMAG available. Possibly bad chart reference. failed VSX request. target not in VSX.
I do this on-line and it should be able to access VSP. The chart ID I assume is at the top right hand corner of the chart where it says "AAVSO Chart". The number underneath is X26445IC.
I don't intend to submit any observations yet. I'm still trying to work all this out.
The standalone version of the TransformApplier, a windows application, is no longer functional. It cannot gather information from the AAVSO via the https links. RIP.
The code has been ported to VPhot. There you will find that it runs just as the old standalone version did with its input window, output window and report window.
- You upload or paste in your webobs submission file.
It is not necessary to prepare that file with VPhot, though you may.
- The transform coefficients are now stored in your telescope profile. You can actually import the ini files that you used with the old TA program.
Try it. You'll like it!
George
Steve
Thank you George.
Steve
To: George,
Do you know what the record limit on TA is in Vphot? I always seem to get a data like this(on T Hya):
"#T Hya,2459276.7446701392,9.344,0.011,V,NO,
warning: Truncated"
It truncated in the middle of my BVI un-transformed file (not even getting to I). The file I pasted into the input box had 804 BVI T Hya measures.
I believe the limit on the PC based TA was just under 1000, but the web-based limit seems much shorter. The truncated record above corresponds
to the 441 T Hya I was trying to transform. Let me know if you want my input file and my .INI file of my Trans coefficients.
James
The output file size limits for TA in VPhot are 200k characters for the output window and 500k for the report window.
Looks like that is effectively 420 observation lines.
There are some VPhot updates in the pipeline; I'll take a look at upping that limit.
Please do send me a copy of your submission file ( gsilvis@aavso.org )
George
To: George,
Thanks for the quick response. Here is a link to my T Hya BVI data generated by MaximDL.
http://astroimage.info/files/T%20Hya(27Oct20-30Dec20)BVI_unTRANSF.txt
Let me know if you need anything else from my to help expand the present Vphot TA limit.
James
Thanks for a peek at the data. Some notes:
- There's always going to be a size limit of some kind. Sometimes you don't need to hit that limit.
- Sort the data by time. It's in IVB groups of 23 observations each spanning 8 minutes.
note that its 9 I, 7 V and 7 B observations, so you they cannot all be in BVI groups.
If you hadn't hit the size limit you might not notice how awkwardly the grouping happened.
- How fast is the phenomena you are trying to capture?
Hmm. It's a Mira. https://www.aavso.org/vsx/index.php?view=detail.top&oid=15962
Not fast. Let's aggregate.
- take each block of 23 in turn and aggregate by filter. So you then have one BVI transform group.
Grouping for aggregation and transform is nominally the users responsibility. TA does a pretty good
job, but in this case it would group all the T Hya shots by filter, 800 observations into 3. Not what you would want.
So, either do groups of 23 or tag the group field. I just tried it:
The group field has NA. I changed the first 23 to 1NA and left a second group just NA. The aggregation created
2 BVI groups. Perfect.
Cheers,
George
To: George,
Can you send me the file you made? After 2 hrs resorting these T Hya manually in notepad, I tried to run them in VPhoto TA but got this:
http://astroimage.info/files/AAVSOReport_20210428_TA-2Failed.txt
I imagine you reformated my data like this(my input file I used to make the above):
http://astroimage.info/files/T%20Hya(27Oct20-30Dec20)BVI_unTRANSFaggravateALL.txt
I dont gather photometry data and process it bit by bit every day (I get 30 or more BVI sets per night) but wait until the object is un-observable before I calibrate and process it photometrically in MaximDL. These sets usually are 4-6 months long so number btw 600-1100 records. Like the T Hya file from the previous message, I sort these according to B(27Oct-30Decv), V(27Oct-30Decv), and I(27Oct-30Decv) and process these frames in MaximDL by unique filter by grouped B or V or I set. Will there still be a push to increase the record number Vphot TA will accomidate? Data sets like my T HYa take awhile to gather and process through my photometric program (Maxim). Usually I need to spit the file before processing or the photometric program crashes, so an additional processing step to count sets and aggregate is time consumming.
Anyway tanks for this. It would be nice if there was a AASVO tool that could induvidually aggregate BVI per date from a pre-existing photometric file to make using groups 100X easier.
While workable using your "aggrates-method" this adds an extra long manual process step to an already long process. I might temporaraly give-up transforming and just submitting my data as is.
James
The correct way to set the groups would be to assign a group number to each BVI sequence. It's important that observations in a group be close in time.
The example you point to above is wrong: it grouped all observations by filter that spanned 63 days.
Yes, setting up for transforms involves some preparation.
Here's how it should look:
#NAME,DATE,MAG,MAGERR,FILTER,TRANS,MTYPE,CNAME,CMAG,KNAME,KMAG,AIRMASS,GROUP,CHART,NOTES
T Hya,2459150.0118258102,6.136,0.030,I,NO,STD,108,16.165,119,17.775,1.647,1,X26493BTT,na
T Hya,2459150.0120341433,6.075,0.030,I,NO,STD,108,16.231,119,17.742,1.646,1,X26493BTT,na
T Hya,2459150.0122540509,6.085,0.031,I,NO,STD,108,16.219,119,17.751,1.644,1,X26493BTT,na
T Hya,2459150.0124623841,6.097,0.029,I,NO,STD,108,16.163,119,17.771,1.643,1,X26493BTT,na
T Hya,2459150.0126938657,6.079,0.028,I,NO,STD,108,16.148,119,17.799,1.641,1,X26493BTT,na
T Hya,2459150.0129137728,6.132,0.028,I,NO,STD,108,16.160,119,17.751,1.640,1,X26493BTT,na
T Hya,2459150.0131452545,6.017,0.030,I,NO,STD,108,16.249,119,17.655,1.638,1,X26493BTT,na
T Hya,2459150.0133651621,6.072,0.028,I,NO,STD,108,16.135,119,17.732,1.636,1,X26493BTT,na
T Hya,2459150.0135850692,5.961,0.031,I,NO,STD,108,16.284,119,17.829,1.635,1,X26493BTT,na
T Hya,2459150.0138483797,10.286,0.036,V,NO,STD,108,15.161,119,16.264,1.633,1,X26493BTT,na
T Hya,2459150.0141145834,10.343,0.035,V,NO,STD,108,15.079,119,16.395,1.631,1,X26493BTT,na
T Hya,2459150.0143692130,10.269,0.048,V,NO,STD,108,15.153,119,16.237,1.629,1,X26493BTT,na
T Hya,2459150.0146354167,10.219,0.036,V,NO,STD,108,15.173,119,16.156,1.628,1,X26493BTT,na
T Hya,2459150.0149016203,10.321,0.033,V,NO,STD,108,15.133,119,16.269,1.626,1,X26493BTT,na
T Hya,2459150.0151562500,10.332,0.032,V,NO,STD,108,15.130,119,16.443,1.624,1,X26493BTT,na
T Hya,2459150.0154224536,10.298,0.034,V,NO,STD,108,15.149,119,16.238,1.622,1,X26493BTT,na
T Hya,2459150.0157754631,11.828,0.038,B,NO,STD,108,15.460,119,16.497,1.620,1,X26493BTT,na
T Hya,2459150.0160995373,11.848,0.040,B,NO,STD,108,15.475,119,16.210,1.618,1,X26493BTT,na
T Hya,2459150.0164236114,11.895,0.040,B,NO,STD,108,15.437,119,16.365,1.616,1,X26493BTT,na
T Hya,2459150.0167592596,11.951,0.041,B,NO,STD,108,15.455,119,16.332,1.613,1,X26493BTT,na
T Hya,2459150.0170717593,11.862,0.042,B,NO,STD,108,15.527,119,16.367,1.611,1,X26493BTT,na
T Hya,2459150.0173958335,11.905,0.043,B,NO,STD,108,15.504,119,16.228,1.609,1,X26493BTT,na
T Hya,2459150.0177662037,11.879,0.039,B,NO,STD,108,15.439,119,16.359,1.607,1,X26493BTT,na
T Hya,2459151.0155063658,6.083,0.018,I,NO,STD,108,15.718,119,17.327,1.603,2,X26493BTT,na
T Hya,2459151.0157841435,6.014,0.021,I,NO,STD,108,15.752,119,17.555,1.602,2,X26493BTT,na
T Hya,2459151.0160040506,5.985,0.020,I,NO,STD,108,15.816,119,17.261,1.600,2,X26493BTT,na
T Hya,2459151.0162355322,6.129,0.017,I,NO,STD,108,15.721,119,17.270,1.599,2,X26493BTT,na
T Hya,2459151.0164554399,6.089,0.020,I,NO,STD,108,15.748,119,17.477,1.597,2,X26493BTT,na
T Hya,2459151.0166637730,6.070,0.018,I,NO,STD,108,15.731,119,17.397,1.596,2,X26493BTT,na
T Hya,2459151.0168836806,6.077,0.019,I,NO,STD,108,15.751,119,17.301,1.595,2,X26493BTT,na
T Hya,2459151.0171035877,6.049,0.019,I,NO,STD,108,15.750,119,17.376,1.593,2,X26493BTT,na
T Hya,2459151.0173119213,6.003,0.020,I,NO,STD,108,15.796,119,17.385,1.592,2,X26493BTT,na
T Hya,2459151.0175752314,10.248,0.018,V,NO,STD,108,14.597,119,15.853,1.590,2,X26493BTT,na
T Hya,2459151.0178414350,10.218,0.017,V,NO,STD,108,14.594,119,15.801,1.589,2,X26493BTT,na
T Hya,2459151.0181076392,10.225,0.016,V,NO,STD,108,14.601,119,15.825,1.587,2,X26493BTT,na
T Hya,2459151.0183738428,10.195,0.019,V,NO,STD,108,14.617,119,15.847,1.585,2,X26493BTT,na
T Hya,2459151.0186863425,10.236,0.019,V,NO,STD,108,14.583,119,15.804,1.583,2,X26493BTT,na
T Hya,2459151.0189409722,10.281,0.019,V,NO,STD,108,14.577,119,15.897,1.582,2,X26493BTT,na
T Hya,2459151.0191956018,10.263,0.019,V,NO,STD,108,14.585,119,15.795,1.580,2,X26493BTT,na
T Hya,2459151.0195138892,11.834,0.019,B,NO,STD,108,14.711,119,15.570,1.579,2,X26493BTT,na
T Hya,2459151.0198495374,11.824,0.019,B,NO,STD,108,14.697,119,15.558,1.577,2,X26493BTT,na
T Hya,2459151.0201736111,11.789,0.020,B,NO,STD,108,14.726,119,15.520,1.575,2,X26493BTT,na
T Hya,2459151.0204861113,11.816,0.019,B,NO,STD,108,14.707,119,15.551,1.573,2,X26493BTT,na
T Hya,2459151.0208101855,11.808,0.019,B,NO,STD,108,14.724,119,15.537,1.571,2,X26493BTT,na
T Hya,2459151.0211342592,11.799,0.020,B,NO,STD,108,14.714,119,15.501,1.569,2,X26493BTT,na
T Hya,2459151.0214583334,11.780,0.020,B,NO,STD,108,14.740,119,15.518,1.567,2,X26493BTT,na
T Hya,2459152.0168258101,6.053,0.019,I,NO,STD,108,15.737,119,17.364,1.578,3,X26493BTT,na
T Hya,2459152.0170457172,6.028,0.019,I,NO,STD,108,15.749,119,17.286,1.577,3,X26493BTT,na
T Hya,2459152.0172771988,6.009,0.019,I,NO,STD,108,15.777,119,17.244,1.575,3,X26493BTT,na
T Hya,2459152.0175086805,6.028,0.019,I,NO,STD,108,15.726,119,17.265,1.574,3,X26493BTT,na
T Hya,2459152.0177170136,6.078,0.019,I,NO,STD,108,15.745,119,17.484,1.573,3,X26493BTT,na
T Hya,2459152.0179369212,6.014,0.019,I,NO,STD,108,15.761,119,17.328,1.571,3,X26493BTT,na
T Hya,2459152.0181799768,6.017,0.019,I,NO,STD,108,15.767,119,17.316,1.570,3,X26493BTT,na
T Hya,2459152.0183883100,6.018,0.020,I,NO,STD,108,15.783,119,17.503,1.569,3,X26493BTT,na
T Hya,2459152.0186082176,6.025,0.018,I,NO,STD,108,15.736,119,17.303,1.568,3,X26493BTT,na
T Hya,2459152.0188715276,10.197,0.015,V,NO,STD,108,14.561,119,15.785,1.566,3,X26493BTT,na
T Hya,2459152.0191261573,10.177,0.014,V,NO,STD,108,14.560,119,15.752,1.565,3,X26493BTT,na
T Hya,2459152.0193923614,10.196,0.025,V,NO,STD,108,14.559,119,15.791,1.563,3,X26493BTT,na
T Hya,2459152.0196701391,10.202,0.015,V,NO,STD,108,14.546,119,15.733,1.562,3,X26493BTT,na
T Hya,2459152.0199247687,10.189,0.016,V,NO,STD,108,14.544,119,15.751,1.560,3,X26493BTT,na
T Hya,2459152.0201793984,10.227,0.016,V,NO,STD,108,14.521,119,15.681,1.559,3,X26493BTT,na
T Hya,2459152.0204456020,10.255,0.017,V,NO,STD,108,14.511,119,15.710,1.557,3,X26493BTT,na
T Hya,2459152.0207523149,11.758,0.016,B,NO,STD,108,14.566,119,15.400,1.556,3,X26493BTT,na
T Hya,2459152.0210648151,11.735,0.017,B,NO,STD,108,14.627,119,15.461,1.554,3,X26493BTT,na
T Hya,2459152.0213888888,11.727,0.016,B,NO,STD,108,14.623,119,15.427,1.552,3,X26493BTT,na
T Hya,2459152.0216898150,11.748,0.016,B,NO,STD,108,14.605,119,15.437,1.550,3,X26493BTT,na
T Hya,2459152.0220023151,11.786,0.016,B,NO,STD,108,14.573,119,15.409,1.549,3,X26493BTT,na
T Hya,2459152.0223263889,11.754,0.016,B,NO,STD,108,14.593,119,15.448,1.547,3,X26493BTT,na
T Hya,2459152.0226504630,11.729,0.016,B,NO,STD,108,14.610,119,15.490,1.545,3,X26493BTT,na
etc.
To: George,
Thanks for the input form. Here is my new input file(33 BVI groups):
http://astroimage.info/files/T%20Hya(27Oct20-30Dec20)BVI_unTRANSFaggravateALL2.txt
When I transformed this and submitted to WebObs, I didn't see 804 records submitted, but only 99; see output file:
http://astroimage.info/files/T%20Hya(27Oct20-30Dec20)BVI_TRANSFORMEDagg.txt
All that text sorting and manipulation into groups takes me 2-3 hrs (more than 3x the processing time for the BVI data in MaximDL!).
If there was a more automated way to aggregate the records instead of manually doing this, I wouldn't mind, but this is way too laborious
to be time efficient. I think I'll have to go the un-Transformed route, since Vphoto-TA is not as versitile as PC-TA...Let me know if the
text limit changes for Vphot-TA, then I'll try transforms again, or if I have a very small batch of magnitudes to process.
James
To: George,
I found away of avoiding the intense text manipulation while getting all my data submitted to WebObs as Transformed. This involved heavy use of MS Excel 2002. As you indicated previously, I sorted my MaximDL photometry file(s), say "T Hya(27Oct20-30Dec20)BVI_unTRANF.txt" according to JD date (column B) and filter (column E). Once this was done I saved to a .csv (comma delimited) file to preserve the commas btw fields; I also had to make sure to preserve the decimale formats to remained the same (as from MaximDL output), as in the JD date requiring 8 decimales from the original data.
Once this was done, I had all my data sorted by JD and by filter to give Vphot-TA an easier time. I still ran into a truncation error, but this was easily addressed by noting the JD-date on the final record before truncation, search for this JD-date in the original MaximDl photometry file (T Hya(27Oct20-30Dec20)BVI_unTRANFaggEXCEL.txt) and taking all the data on this JD-day as the 1st record to a 2nd input file (say T Hya(27Oct20-30Dec20)BVI_unTRANFaggEXCELb.txt). I made sure this data to the 2nd file was cut from the 1st file (renamed as T Hya(27Oct20-30Dec20)BVI_unTRANFaggEXCELa.txt) and resubmitted to TA and it worked without truncation! These two files, plus my other set of T Hya from 01Jan21-10Apr21 resulted in 1,679 records submitted to WebObs! Yea!
Thanks again for your time and help...using Excel cut resorting txt records from a manual job of 2 hrs to a spreadsheet job of less than 5 minutes, plus it preserved the number of actual records I invested in telescope time....as you mentioned as not as important on non-time varying objects like long period variable (LPV)...but makes processing much easier without looking at each record bit-by-bit and manually aggregating them; I called these files "aggravate" as I was very annoyed my poor old brain was used to manually sort stuff that the computer should be doing instead 1000x time easier!
James