georeference.org
Subscribe to this thread
Home - General / All posts - open source map
adaptagis

480 post(s)
#10-Jun-08 09:06

Hi everyone

I would like to encourage you to contribute some datas to the open source map organisation

it's easy, its cool and we hope that manifold will soon be able to import the osm datas staight into the system.

for now some osm datas have been converted into shp files.. see for example:

OpenStreetMap for Europa as shp:

http://download.geofabrik.de/osm/europe/

login to : http://www.openstreetmap.org/

It helps not only you and the holiday campers but also rescue and development aid workes..

thank you!

petzlux

982 post(s)
#10-Jun-08 09:33

Just for the benefit of everyone who wants to work now with Openstreetmap Data, and cant rely on the shapefile conversions (last time I looked, they castrated most of the tags off the data, thus reducing significantly the data usefulness).

I have done some work in developing a OSM import script for Manifold, and it is pretty much functional now. We have managed to download and import into Manifold with this tool the whole of the Greater London area.

I recently also started work on a upload script for OSM, but this is still very much work in progress, and I would appreciate any help in developing this upload tool. My ultimate goal would be to make Manifold a fully functional OSM Editor suite, as the exisiting editing software tools such as JOSM are akward to use and dont allow any data import outside of gpx files.

I attach here the small readme for this project:

This a tool that connects to the API of the OpenStreetMap Project, which offers open sourced (Creative Commons

share-alike license) mapping data collected by its members.

Download Section:

-----------------

To use the script to download data, just open the attached map file, navigate in the "Download Map" Window to an

area of interest and run the "OSM Download" script. It will create a new drawing which will contain the data.

For the moment I create the Areas from all closed ways that have specific tags, as you can see in the sourcecode.

You will need to link back the extended tags to the Geometry Data using the Pivot Query.

Relations are so far not supported.

Upload Section:

---------------

This is very much still a work in progress. So far I have managed to successfully upload Point Data. Ways are

more complicated, especially as there are topological differences between the Manifold Data format and OSM data

format. E.g. in Manifold, each line will be represented by internal inflection points (which are held for each

branch) which may overlap, but still are separate entities. In OSM, each way is represented by an ordered series

of referenced node ID's, and two ways can and will share the same node ID for each intersection of that way. If

they share a node or not matters in terms of topology, in other words two roads can either be connected by a

junction (with attributes), or not for example because of a bridge. How we model that in Manifold, I dont know

yet.

thanks to Muki Haklay for helping me with speeding up the download code.

Patrick Weber

p.weber@ucl.ac.uk

Attachments:
OSM Streetmap Import and Export Script - cleaned up forum version.map


Check out the Manifold Wiki with SQL and scripting examples at http://www.manipedia.eu/

Spatial Knowledge, my personal blog.

adaptagis

480 post(s)
#11-Jun-08 01:49

Excellent job Muki and Patrick!

I hope that many Manifolders will jump on the osm train and contribute some datas.

An export skript would be awsome! I cross my fingers that it will be implemented soon.

maybe manifold tech can help out if things get too rought..

James

316 post(s)
#11-Jun-08 03:56

This Open Streetmap tool is excellent. Recently, having been getting really fed up with the current licensing regime for Ordnance Survey data, we have been contributing a lot of data to OpenStreetmap with a view to replacing smaller scale OS data with open source OpenStreetmap data. The Mapnik rendering engine they are using is state of the art and produces really nice maps!

Because of the model upon which Open Streetmap has been set up, edits appear really quickly on the map. It's not like waiting around for the Ordnance Survey to get around to something. If you capture a new street, it's on the map within an hour if you request a render. We're looking at setting up an 'internal' Open Streetmap system using the Mapnik engine so we have a locally controlled set of data, but still feed back any changes or additions into the Open Source community.

My current work flow is a bit tedious. My Manifold map file is set up to British National Grid which is what we usually work in and what my air survey images are projected to. I digitise road centrelines from the air survey (to all those interested make sure you have permission from the air survey data supplier to do this....quite often, in the UK, air surveys on Google etc contain Ordnance Survey intellectual property rights because of the underlying data that was used to ortho the images...beware!).

Once I've digitised the area I'm working on I export this to a shape file. I then open this in GPS Utility and convert it to a GPX file. Load the GPX file into OpenStreetMap's JOSM Java Editor. Hit the download OSM data button and the software will download any additional Open StreetMap data in your area of interest. Digitise or 'trace' over your imported GPX file streets adding tag info such as highway classifications and streetnames and then hit the upload button and send it all back to Open StreetMap servers.

Over on informationfreeway.org you can go and request a render for the area that you've just sent data to and it will render your tiles quickly for you. Otherwise you can wait until a Wednesday when the whole OpenStreetmap dataset is re-rendered.

petzlux

982 post(s)
#11-Jun-08 04:44

Another component to develop a Manifold OSM editing capability would be to have a ImageServer Module available for Yahoo Aerial Imagery web service. I dont know how to code that, probably can take one of the existing imageserver modules as "inspiration". Anyone with experience here on how to develop custom imageserver modules?


Check out the Manifold Wiki with SQL and scripting examples at http://www.manipedia.eu/

Spatial Knowledge, my personal blog.

volker

701 post(s)
online
#11-Jun-08 10:36

Yahoo Arial Image Server, i asked in this thread, but until now, it doesn`t exist.

http://forum.manifold.net/forum/t64881.5

Your script is a very useful tool. Thanks a lot Patrick.

If the upload works, i will send a lot of datas to osm ...


http://www.thegisservicesector.de

adamw


4,765 post(s)
#16-Jun-08 04:03

I think you should be able to use JOSM / YWMS which makes Yahoo Aerial Imagery look like a local WMS service. You would install and configure JOSM and YWMS (for instructions, start here), then launch Manifold and connect to YWMS via File - Link - Image, OGC WMS Servers(), specifying something like http://localhost:8000/ymap as a URL.

conorobeirne8 post(s)
#14-Jul-08 05:05

This is a really great feature!!! I have been looking at the source on this thread and it is fantastic for getting the Open streetMap data.

I dont seem to be able to read the .map files on this post - I get a "Cannot read data stream" error, possibly because I am still on Manifold 7.1 (missed the upgrade window !!)

Any chance you could post the VB Script straight up on a post so I can copy & paste. I have the code to read the nodes, but dont have code to join them up into the Ways (roads) and areas, seems a wster tro re-invent the wheel.

Really great work by everyone who contributed!!

thanks

Conor

lionel_

671 post(s)
#14-Jul-08 07:37

here is the zip file that contain all the file export from the map file

osm is great project with open layer ......miss multilanguage video tutorial about tool ( josm )

find yahoo image resolution poor and not very useable for me .


chat with manifold user using firefox , chatzilla and irc.freenode.net

Attachments:
OSM Streetmap Import and Export Script.zip

peterstib45 post(s)
#29-Nov-08 10:55

This is a really useful tool - many thanks for the work that has gone into it. Can I ask you to enlarge slightly on the ReadMe where it says 'You will need to link back the extended tags to the Geometry Data using the Pivot Query.' I'm not sure on the procedure here. I think I'm doing the correct thing but the results are not quite as I'd expect, though it may be because something is lacking in the tagging of the OSM information. Should I expect 'Ways' (Roads, for example) to appear as a set of linked nodes which I then need to group and convert to a line in Manifold - or am I not using the Pivot Query correctly?

It's going to make a major time saving in the process of bringing together the East Anglian data on which I'm working.

lionel_

671 post(s)
#03-Dec-08 08:50

there is a .Net framework/tool for access to openstreetmap perhaps code source is availabe or could be use for an implement and isi driver ( deal with zoom, projection ,bounding box, raster size,urls images,x,y) .

the name of the project is Scout tool and use http protocol

Seem there is no free availabel .NET API for REST

http://www.codeplex.com/OsmScout

-------------------------------------------------

a silverlight application using deepzoom

http://deepzoom.soulclients.com/osm/

petzlux

982 post(s)
#04-Dec-08 02:32

Peter

the instructions indeed are a bit dense. Let me explain.

As part of the import process, the script only keeps some of the major tags in the main OSM Import Drawing (with geometry). This is done to speed up the import and keep the Drawing Size to the minimum for speedy display.

All other tags are saved in the separate Data Table as ID,Key,Value triplets. Then, using an appropriate Pivot Query, you can recreate a data table containing these tags, where each column represents a key,along with a column that contains the OSMID each row of attributes belongs too.

I hope this helps


Check out the Manifold Wiki with SQL and scripting examples at http://www.manipedia.eu/

Spatial Knowledge, my personal blog.

adaptagis

480 post(s)
#04-Dec-08 05:00

Hey Patrik and Muki

has there been any breakthrough regarding the export to OSM script for lines yet?

johnrobot
298 post(s)
#04-Dec-08 05:51

Those of you who are interested in using OSM data with Manifold, don´t forget to send sales a request for adding OSM support (such as import) to Manifold. I hope to see it in the upcoming v 9.

James

316 post(s)
#04-Dec-08 10:57

I'll be putting a request in ....left it a bit late really. We use Manifold as part of a work flow to contribute data to OSM. We're digitising all buildings at the moment which look really neat in OSM

http://www.openstreetmap.org/?lat=51.35292&lon=-0.59869&zoom=16&layers=B000FTF

One of the other GIS systems we use (no not ESRI!!) now connects directly to OSM tile server so we can bring OSM data as a background map. The spherical projection that OSM uses is a close enough approximation to British Grid at large scales so you can display it without having to reproject anything which is really neat!

I'd love to see Manifold just connect to the OSM tile server.

petzlux

982 post(s)
#04-Dec-08 15:26

adaptgis

i made a start on the export of points, which is simple enough. i simply havent had time to sit down and spend a couple of afternoons getting the export function for lines going yet. i would appreciate any contributions!


Check out the Manifold Wiki with SQL and scripting examples at http://www.manipedia.eu/

Spatial Knowledge, my personal blog.

mapbutton2 post(s)
#05-Feb-10 07:50

I think that this work is great, having just discovered how easy it was to use the ISI drivers to bring in OSM tiles.

Just one minor observation, OSM is now on API version 0.6, so the html connection in the script needs to be changed from 0.5 to 0.6.

Thank you for writing this script though.

0 msec Copyright (C) 2007-2008 Manifold.net. All rights reserved.