2010-05-12T05:10:34 *** goffena has joined #opticks 2010-05-12T05:36:25 *** dsulgrov has joined #opticks 2010-05-12T06:17:47 *** tclarke has joined #opticks 2010-05-12T06:17:47 *** ChanServ sets mode: +o tclarke 2010-05-12T07:02:03 *** kstreith has quit IRC 2010-05-12T07:02:13 *** kstreith has joined #opticks 2010-05-12T07:02:13 *** ChanServ sets mode: +o kstreith 2010-05-12T07:29:10 . 2010-05-12T07:29:26 Continuing from kstreith's "Future Roadmap and Visual Studio 2010" email 2010-05-12T07:29:41 yes 2010-05-12T07:29:44 Will you be pushing OPTICKS-516 back to 4.5.x as well? 2010-05-12T07:29:54 that's scheduled for 4.4.0 right now 2010-05-12T07:30:20 Are you still planning on upgrading dependencies in 4.4.0, or will you wait until 4.5.0? 2010-05-12T07:30:40 only a few deps will be upgraded for 4.4.0 2010-05-12T07:30:41 just gdal and xerces/xqilla at this point 2010-05-12T07:30:42 the majority for 4.5.0 2010-05-12T07:30:46 and maybe boost since it doesn't require a compile 2010-05-12T07:30:59 ok 2010-05-12T07:45:15 New news from opticksannounce: Updated roadmap for Opticks releases 2010-05-12T07:55:23 *** gmartin_cn has quit IRC 2010-05-12T07:56:43 *** gmartin_cn has joined #opticks 2010-05-12T08:10:21 *** Dom_ has joined #opticks 2010-05-12T08:11:26 Good morning 2010-05-12T08:11:27 hello 2010-05-12T08:11:41 Dom_: i read the logs from yesterday and saw your conversation with rforehan 2010-05-12T08:11:42 how can I help? 2010-05-12T08:12:05 Well, I'm really new to Optick, I downloaded and installed it yesterday 2010-05-12T08:13:42 I've brought in a tiff image of a band 1 spot image and from here I'm not sure how to bring in more than one band 2010-05-12T08:13:46 to answer your question yesterday about combining multiple files into a single, there are a couple of ways to do that right now...they are a little tricky tho 2010-05-12T08:14:04 OK, I don't mind learnign if you don't mind walking me through it 2010-05-12T08:14:06 first, you can use another tool such as GDAL to do this...with GDAL, it requires a python script...I can give you one which works for Landsat and may work for SPOT (you may need to modify it a bit for SPOT) 2010-05-12T08:14:09 the other uses just opticks but has more steps: 2010-05-12T08:14:13 1) load each band as a separate image 2010-05-12T08:14:15 GDAL is a second software? 2010-05-12T08:14:17 2) export each to an ENVI file 2010-05-12T08:14:25 Each tif image? 2010-05-12T08:14:25 Dom_: Yes, http://www.gdal.org/ 2010-05-12T08:14:26 3) use Opticks to import multi-file BSQ data from the ENVI raw files 2010-05-12T08:14:29 yes, gdal is the other software 2010-05-12T08:15:37 depends on how often you need to do this 2010-05-12T08:15:42 if it's just once, it's probably easier to do in Opticks alone 2010-05-12T08:15:48 OK i'm going to do the steps your telling me about 2010-05-12T08:15:49 if you have lots of data to convert, I'd suggest GDAL as it is more automated 2010-05-12T08:15:54 the last step is the trickiest 2010-05-12T08:16:13 what you need to do is write down the number of rows, columns, and bands 2010-05-12T08:16:19 as well as the data type (1-byte, 2-byte, etc.) 2010-05-12T08:16:19 ok, one second ok? 2010-05-12T08:16:21 sure 2010-05-12T08:16:23 let me know when you are ready 2010-05-12T08:22:26 When I import, I just the multi files, I just do file > import > bring in my ENVI files? 2010-05-12T08:22:33 you've created the 4 envi files? 2010-05-12T08:22:37 yes 2010-05-12T08:22:49 ok, you need to go to file->import and when the dialog appears, select Generic Importer from the "Importer:" field 2010-05-12T08:24:06 select the first data file (not .hdr file, the other one) and hit Options 2010-05-12T08:24:13 once the options dialog appears, go to the File tab 2010-05-12T08:24:16 ok, this makes it so I have two files of each band, so 8 altogether 2010-05-12T08:24:31 ok, you can only use this trick to combine 1 file per band....it will not do spatial mosaicing 2010-05-12T08:24:44 you can import the two sub-frames as separate, multi-band images however 2010-05-12T08:25:00 Ok I'm in the file tab 2010-05-12T08:25:03 when you get to the File tab, you need to enter the number of rows, columns and bands 2010-05-12T08:25:08 then select BSQ-Multiple File for the interleave 2010-05-12T08:25:15 that will enable an + in the Filename field...open that up 2010-05-12T08:25:17 and select the data file for each band 2010-05-12T08:25:18 OK, where do I find the information on rows, column and bands? 2010-05-12T08:25:42 the easiest way to get that is to look in the import options page when you select either the GeoTIFF importer (with the original files) or the ENVI importer (with the .hdr files) 2010-05-12T08:25:52 ok i'll go take a look 2010-05-12T08:25:54 you can hit cancel, select the ENVI importer from the Importer drop down 2010-05-12T08:25:56 then hit Options again 2010-05-12T08:28:13 jot down the rows, cols, bands and Data Type which show up 2010-05-12T08:28:23 then you can switch back to the Generic Importer and type that data in 2010-05-12T08:28:37 ok I've done that for the first band 2010-05-12T08:28:39 the last step is needed if the Data Type is not Unsigned 1 Byte...if it's not, then when you are done with the File Tab, go back to the Data tab and change the Data Type 2010-05-12T08:28:50 the first band is enough since the rows, columns, and data type should be the same for all the bands 2010-05-12T08:28:57 it is unsigned 1 byte 2010-05-12T08:30:22 ok, you can skip that last step since unsigned 1 byte is the default 2010-05-12T08:30:28 ok so once I've put in that data what do I do? 2010-05-12T08:30:31 once you've entered the rows, cols, bands, bits per element, multi-file BSQ, and the band files, hit ok 2010-05-12T08:30:32 then hit open 2010-05-12T08:30:34 and it should load the data 2010-05-12T08:30:38 you'll get a grayscale view by default 2010-05-12T08:30:44 ok I"ll go give it a try 2010-05-12T08:30:56 click in the window to give it keyboard focus, then hit T to switch to RGB mode...then hit a band number followed by R G or B to set that color channel...for example: 2010-05-12T08:30:59 T1R2G3B 2010-05-12T08:31:02 and you should have a color composite 2010-05-12T08:32:38 when you have imported this, you can export the resulting file to GeoTIFF, ICE (the Opticks internal format) or another format so you don't need to do anything special next time 2010-05-12T08:32:44 once you've re-exported the multi-band image, you can delete the intermediary ENVI files 2010-05-12T08:34:29 OK I"ll play around with it 2010-05-12T08:34:32 I really appreciate your help 2010-05-12T08:34:35 as I said, this is a little convoluted procedure 2010-05-12T08:34:35 but it works 2010-05-12T08:34:43 if you need to convert multiple datasets, you can use something like GDAL then import the result into Opticks 2010-05-12T08:34:51 and keep an eye out...we are hoping to have a way to automate this at the end of the summer 2010-05-12T08:34:54 let us know if you have other questions 2010-05-12T08:34:54 . 2010-05-12T08:37:29 I think I missed a step in the importing 2010-05-12T08:38:41 I didn't see anything relating to multi-file BSQ, and the band files 2010-05-12T08:38:45 in the File tab 2010-05-12T08:38:48 you see an Interleave combo box 2010-05-12T08:38:52 change that from BIP to BSQ - Multiple Files 2010-05-12T08:38:59 *** rforehan has joined #opticks 2010-05-12T08:39:00 once you do that and have the number of bands set, you'll see a + appear in the File tab next to the filename 2010-05-12T08:39:06 open up that and you'll see entries for each of the band files 2010-05-12T08:39:28 I went into option in the + of the band and figured it out 2010-05-12T08:39:30 Thank you 2010-05-12T08:43:05 I have to bring in all the ENVI files for the one band to have the option to use them as the bands right? 2010-05-12T08:43:35 I assume the 2 files per band are different spatial areas (top half/bottom hald)? 2010-05-12T08:45:20 opticks does not do general spatial mosaicing so you'll need to do that with another tool 2010-05-12T08:45:27 typically a GIS tool would be used to do this sort of processing 2010-05-12T08:45:27 no I just missed a step, I think I've got i tnow 2010-05-12T08:45:41 if you're refering to the .hdr vs. regular file, then you ignore the .hdr....it contains header information used by ENVI 2010-05-12T08:45:43 Mhmm.. We are using an outdated version of ArcInfo 2010-05-12T08:46:56 But we work with satellite imagery often, So i thought I'd grab something that was better suited to manipulating it 2010-05-12T08:49:01 depends what you want to do as far as manipulation 2010-05-12T08:49:20 does optick mosaic images? 2010-05-12T08:49:23 Opticks is a MASINT tool and is thus not particularly suited to GIS type tasks (spatial mosaicing, orthorectification, etc.) 2010-05-12T08:49:29 Ahhh 2010-05-12T08:49:29 we focus more on non-literal processing 2010-05-12T08:49:34 like? 2010-05-12T08:49:42 signature matching, anomaly detection, video tracking, etc. 2010-05-12T08:50:55 but we have a very robust extension API so you can write algorithms to do almost anything you need 2010-05-12T08:51:05 primary language is C++ but we have a trimmed down API available for IDL and Python 2010-05-12T08:51:27 some other algorithms we support out of the box are PCA, general band math, QT cluster, MNF, SAM, CEM 2010-05-12T08:51:28 ELM 2010-05-12T08:51:37 IARR 2010-05-12T08:51:47 there's a Python sample for calculating NDVI from arbitrary MSI and HSI data 2010-05-12T08:51:54 Hmmm... I am a little famiiar with python but the rest of that is a little over my head 2010-05-12T08:51:54 and one which implements classic RX-D 2010-05-12T08:53:25 Do you know of an open source software which may be a bit more suited to what I need? 2010-05-12T08:53:27 PCA and MNF rotate the spectral space such that common (highly correlated) parts of the data appear in lower numbered "bands" and less correlated stuff in higher "bands" 2010-05-12T08:53:32 osgeo.org has a bunch 2010-05-12T08:53:36 GRASS and qGIS come to mind 2010-05-12T08:53:46 they are closer to the Arc tools (where we are closer to ENVI, SocetGXP, RemoteView, etc.) 2010-05-12T08:55:10 The software I used in school was Geomatica, ever heard of it? 2010-05-12T08:55:16 I'd be looking for something similar to that 2010-05-12T08:55:23 I have not....my office mate has heard of it but doesn't know much about it 2010-05-12T08:55:44 ok 2010-05-12T08:55:47 a quick look suggests it's a combined tool 2010-05-12T08:55:50 does GIS and some non-literal 2010-05-12T08:55:52 I might go take a look at Grass 2010-05-12T08:55:58 Yeah, some of the interface was very similar to optick 2010-05-12T08:56:01 you can jump over to #osgeo on this IRC server 2010-05-12T08:56:05 But your h elp this morning was already pretty good 2010-05-12T08:57:09 they can help with those tools 2010-05-12T08:59:28 cool Thank you very much, I really appreciate your help. I will most likely keep Optick around anyways 2010-05-12T08:59:35 Did you say you had a python script for mosaicing? 2010-05-12T08:59:42 I'll post it for you 2010-05-12T08:59:43 hang on 2010-05-12T08:59:47 Thanks 2010-05-12T09:01:31 http://pastebin.com/Nmq05EqB 2010-05-12T09:01:45 requires numpy and gdal for python...go to gdal.org and you'll see a pre-built set of tools called FWTools which should contain everything you need 2010-05-12T09:03:30 ok, I might go take a look at Grass before testing this out 2010-05-12T09:03:32 Thanks again for your help! 2010-05-12T09:08:15 *** epifanio has joined #opticks 2010-05-12T09:18:57 *** Dom_ has quit IRC 2010-05-12T09:25:18 *** tclarke has quit IRC 2010-05-12T09:29:17 *** tclarke has joined #opticks 2010-05-12T09:29:17 *** ChanServ sets mode: +o tclarke 2010-05-12T11:45:40 New news from opticksspectrum: Trevor Clarke Blog: Importing multiband BSQ data from multiple files || Optick Illusions: Opticks Extension Development - Get Started In Less Than 15 Minutes 2010-05-12T11:49:40 *** Dom_ has joined #opticks 2010-05-12T11:49:41 New news from opticksannounce: Only 3 Weeks Left to Win Opticks Programming Contest 2010-05-12T11:58:23 Hey, I have another question if Anyone has a moment 2010-05-12T12:00:04 go ahead 2010-05-12T12:00:39 I downloaded fwtools 2010-05-12T12:00:56 and I was wondering, If I'mgoing to mosaic two satellite images using a pythin script, do I need to only have a python window open or the fwtools exe? 2010-05-12T12:01:05 tclarke stepped out for a moment 2010-05-12T12:01:08 he might be able to answer this question 2010-05-12T12:01:14 ok :) 2010-05-12T12:11:19 you'll probably need to use the FWtool command prompt then run python from there...it uses its own installation of python so if you have another on your system it won't have access to the gdal modules 2010-05-12T12:14:59 ok 2010-05-12T12:15:09 So If I open the FWtools, Do I load the datasets I want to mosaic? 2010-05-12T12:15:31 are you using the command line tools or the OpenEV application? 2010-05-12T12:15:47 I have both open at the moment 2010-05-12T12:15:58 which is best to use? 2010-05-12T12:16:00 I've never used OpenEV so I'm not sure if that can do it or not. 2010-05-12T12:16:06 the various gdal utilities are documented here: http://www.gdal.org/gdal_utilities.html 2010-05-12T12:18:38 if you want to spatially mosaic, I believe gdal_merge.py will do what you need 2010-05-12T12:18:42 if not, you may need to write a script to do it 2010-05-12T12:18:57 gdalbuildvrt may also work 2010-05-12T12:19:15 it builds a "virtual dataset" which is a mosaic...once you have a vrt built, you can use gdal_translate to turn it back into a geotiff (or other format) 2010-05-12T12:19:20 http://pastebin.com/Nmq05EqB this one you don't think will? 2010-05-12T12:19:31 that will combine multiple bands into a single multiband file 2010-05-12T12:19:36 but it does not mosaic (which is a purely spatial composite) 2010-05-12T12:19:38 Oh ok 2010-05-12T12:20:54 Well I'll play around with the merge.py script see what I can come up with 2010-05-12T12:20:57 building a mosaic takes multiple files which cover different, adjacent areas and turns them into one larger image 2010-05-12T12:20:58 Thank you 2010-05-12T12:21:23 Yeah, Thats what I'm trying to do. I have some satellilte imagery i need to mosaic together 2010-05-12T12:21:37 the script I sent you requires that the files be exactly the same resolution, etc. just different bands 2010-05-12T12:23:03 Oh ok, I understand what you mean 2010-05-12T12:23:06 I think themerg one will work. 2010-05-12T12:23:08 I'm going to take a look 2010-05-12T12:23:17 ok 2010-05-12T13:35:30 rforehan: you there? 2010-05-12T13:39:02 I'm kinda here 2010-05-12T13:39:08 Been paying around with stuff all afternoon 2010-05-12T13:39:11 playing* 2010-05-12T13:45:51 that was for rforehan...keep playing :) 2010-05-12T13:48:14 oh lol ok :) 2010-05-12T13:53:33 *** tclarke has quit IRC 2010-05-12T13:55:52 *** dsulgrov has quit IRC 2010-05-12T14:04:23 *** Dom_ has quit IRC 2010-05-12T17:46:08 *** rforehan has left #opticks 2010-05-12T23:45:11 *** gmartin_cn_ has joined #opticks 2010-05-12T23:47:24 *** gmartin_cn has quit IRC 2010-05-12T23:47:24 *** gmartin_cn_ is now known as gmartin_cn