When Pop Culture and GIS Collide

Was really surprised yesterday when I looked at site statistics and saw traffic was 4 times normal. Intrigued I took a look at the most recently created maps and found this:

Cruise Itinerary for MI3 on 5/3/06

Apparently somebody created an “Itinerary” for Tom Cruise’s launch of MI3 and posted it online. Is it real? Well I guess that doesn’t matter to the following celebrity news outlets that linked it:

gawker.com
bestweekever.tv
fark.com
gothamist.com

I don’t know what to say… I am, uh, happy for this? Although celebrity news to me is equivalent to the lowest form of spam, I am glad people found a use for the batchgeocoder for something unique.

Everyday is a suprise…

REMINDER: Any map you create on batchgeocode.com will not end up all over the internet unless you want it to. Links are not published in any form, so it is up to you to keep them to yourself or distribute them if you’d like.

SRC Open Sources their Geocoder

Read over at DirectionsMag that SRC has chosen to open source their Explorer geocoding product. I love the idea of putting more tools out their in the open source arena, especially in the area of geocoding. But remember its all about that data, and these days its seems like getting data coverage is the hardest part.

So assuming you take your open source geocoding software and some free TIGER data, you are set to start geocoding on a mass scale. Does anyone have feedback on just how good TIGER is these days?

Geocode right from Excel

Esin S sends along this clever script that uses Yahoo’s REST geocoding service to geocode right in Excel (replace appid=XXXX with your own appID):

Function gCode(Street As String, city As String, state As String, zip As String) As String

Dim XMLDOC As MSXML2.DOMDocument
Dim xm, xm2 As IXMLDOMNodeList
Dim init, ConnectURL As String
Dim temp As IXMLDOMNode
Dim doc As MSXML2.IXMLDOMElement
Dim l As String

init = “http://api.local.yahoo.com/MapsService/V1/geocode?appid=XXXX&“
Street = Replace(Street, ” “, “+”)
state = Replace(state, ” “, “+”)
city = Replace(city, ” “, “+”)
init = init & “street=” & Street & “&city=” & city & “&state=” & state & “&zip=” & zip

Set XMLHTTP = CreateObject(“Msxml2.XMLHTTP.4.0″)
Set XMLDOC = CreateObject(“Msxml2.DOMDocument.4.0″)
strUrl = init
XMLHTTP.Open “GET”, strUrl, False
XMLHTTP.send
If XMLHTTP.Status = 200 Then XMLDOC.loadXML (XMLHTTP.responseXML.XML)
Set doc = XMLDOC.documentElement
l = XMLDOC.childNodes(1).childNodes(0).Attributes(0).nodeValue
gCode = l
End Function

Now with Worldwide Satellite Imagery

I had some time to incorporate the latest features from Yahoo’s version 3 of their AJAX API.

The main feature is international satellite imagery, this can be enabled by selecting “SAT” from the menu on the left. There is also an option on the batch geocoder for defaulting the view to either Street, Satellite, or Hybrid. This will be good for saved maps especially.

Version 3 seems to be quite a bit snappier performance wise as well. Let me know what you all think of the new features.

About Data Security and Privacy

I get quite a few questions related to how secure and private data ran through the bulk geocoder will be kept. The quick answer is: Your data never really leaves your computer.

To explain, here’s what happens when you use batchgeocode.com. You paste your data into the field on the screen and validate it. You then select which field is which and select what map options you want and so on. So far so good, you haven’t even accessed the internet since you loaded the page (you can prove this on your own by unplugging your network cable after loading the page.)

The step of actually running the geocoder (and drawing the map) is the only step that actually interacts with the internet. However the only data that is actually transmitted is your address data, and it is not attached to any other information you may have included. So if someone out there happened to be interested enough to sniff the HTTP traffic, all they would see is a bunch of addresses, with no contextual information to place them in.

Even the process of drawing the map keeps your data a secret. The only request that goes to the internet is to Yahoo to download the few map tiles that surround your geocoded points. So if our persistent GIS data hacker is still listening, all he sees is a few tiles fly by for Paris, Texas or Sacramento, California… Or wherever. Point is even when your little map points show up on the map, your data is still kept local to your computer. The entire process is just done in JavaScript client side in your browser.

Now, say you choose to use the “Save Map to Web Page” feature… Well this will actually send your data to our server where they will be saved. So if you just can’t have your data go over the Internet, stay away from this option. “Download to Google Earth” sends the data as well, but it is never saved, just put into a KML which gets sent back to you and then destroyed.

A bit more on “Save Map to Web Page,” doing this will not automatically publish your information to the Internet so to speak. It will be available to anyone who knows the URL, but guessing the URL is impossible. So unless you choose to share it with anyone, it will remain a secret. You can use it in this way to create maps that are of personal interest to you, but no one
else.

Hope that clears things up, if you have any questions please feel free to use the comments feature. If your one of those secretive types, you can even post anonymously.

Yahoo Maps Goes Global with International Support

Update: I guess I jumped the gun a bit in assuming the international support went further then it did. It looks like only major roads are available internationally, and thus geocoding support is limited. Lets hope that they update again soon enough, aerial photos aren’t much good if you don’t know where to look!

Original Post:
Yahoo dropped a bombshell today announcing international data coverage support, a new and improved developer API, and the addition of aerial photos. You can read more about it here.

It might take me awhile to sort out all the areas that are covered by the new geocoder, but so far I have tested:

• France
• England
• China
• Australia
• Japan
• Germany
• Etc!

For me tracking down addresses in all those countries to test wasn’t easy, and Yahoo hasn’t come forward with the full list yet so it might take awhile to figure out what the coverage really is. The great news is that the batch geocoder was automatically updated with support for international addresses when Yahoo made the change. Please post any feedback here.

I should be able to fairly quickly update the other pages to reflect the other updates which include aerial photo support. This is really exciting!

Make your own KML (for Google Earth)

I have no real way of knowing just how popular the “Download to Google Earth” option is on our geocoder. This because once you load the home page, you could request KMLs all day and I don’t see them as new page views in the logs. I have heard from several people who are using it successfully to create libraries of KMLs, which they then mix and match setting up different colors for different data. (If you want to add your colors, just add a “color” column to your source data and throw in an Hex RGB value for the color.)

KML is pretty cool. It lets you do some amazing things, with a very simple XML based syntax. The great thing about it, is unlike popular GIS formats like an ESRI shapefile, both the data and the rendering information are stored in the KML. This means when you send your KML file to your buddy, he can open it up in Google Earth and immediately visualize it in the same way you do. With classic GIS data, your buddy would need to set up his own rendering parameters, which probably are going to end up different than what you are looking at.

With ESRI’s Arc8 suite, there became a concept of the “layer file” and MXD, both store a pointer to the data as well as the rendering information, however neither store the data itself. ESRI gives you ways of storing information, and storing rendering parameters… but never together. There have been attempts to do this in the past, but they never seem to make it into the standard ArcMap. Word on the street is this will be changing in future versions of the Arc9 suite, but its funny its taken so long to get to that point.

Backwards compatibility are other big problems for ESRI data formats and MXDs. If I save an MXD in Arc9, you will not be able to read it in Arc8. Likewise if I have an ArcSDE 9 database, you will not be able to connect to it in Arc8. This presents huge problems for enterprise GIS users, who are forced to upgrade everyone at once or have dual environments for newer and older versions of the software. Unfortunately this seems to be a problem that won’t be fixed any time in the near future.

Google got it right the first time, whereas ESRI has been doing it for over 30 years now and they still aren’t there. So who is the real map expert?

Google Maps API Version 2.0

Extra extra! Read all about it.

What’s nice:

• No more page view limits
• Some memory leak fixes
• A promise on warning before an ads launch, and promise to not have ads in the near future (though you can bet its coming)

I am a little disappointed (but not surprised) that they don’t have an answer to Yahoo’s geocoding features in their latest release. Maybe we’ll see them as part of some commercial package in the future.