Transcript Web-GIS portal for multi-source geographic data of Nordic Sea

Web-GIS portal for multisource geographic data of
Nordic Sea
Name :Phalguni Pal
Supervisor: Dhayalan. Velauthapillai
Nansen Environmental and Remote
Sensing Center
Outline of the talk









Introduction
Problem definition
Objectives
Software and tools
Database (ODB)
Initial work
Challanges
Discussion
Conclusion
Introduction


Nansen Ceneter(NERSC) : an
independent non-profit research
institute affiliated with the University
of Bergen.
Basically work on applied
environmental research.
Introduction 2


This master thesis is combination of two projects
running at Nansen Center called DISPRO and
INTAS.
DISPRO:




European research project.
Currently running on Nansen Center.
Web-base GIS system.
Monitoring oil spills and harmful algal blooms
using satellite images.
Indroduction3
•
INTAS:




EU project running at NERSC.
Oceanographic data (OD) collected
from Nordic sea.
Huge number of unorganized data.
Make a well managed ODB.
Problem definition



Prepare oceanographic data for a
suitable & well organized way
Display the informations in the
browser with user friendly manner
To avoid use of expansive GIS tools
e.g. ArcExlporer,
Problem definition



Prepare oceanographic data for a
suitable & well organized way
Display the informations in the
browser with user friendly manner
To avoid use of expansive GIS tools
e.g. ArcExlporer, Idealware, ArcMap
etc.
ODB of INTAS :


Huge numbers of data collected during the
period 1882-2007 from North Atlantic with
the NS sub area.
Three different databases and data
processing:
 Initial data with chance of duplicity.
 Observed and interpolated data.
 Objective analyzed monthly fields data with
errors estimates.
Data Processing:
Initial data with chance of duplicity:
Error estimation process:
1.Download data (more than 20 converters) from initial sources to separate
databases.
2.Quality control for all initial databases (9 procedures).
3.Standard deviation flags.
4.Interpolation at the standard levels.
5.Objective analysis of the monthly fields (with kriging errors estimates).
Quality-duplicate
controlled, merged initial
database
Observed and interpolated data.
Objectively analyzed
databases for
requested grid net
Objective analyzed monthly fields data with errors
estimates.
Mean and anomalies
fields at standard levels,
in layers and on density
surfaces
NS database content: reference period for anomalies
computing
Year
0
1
2
3
4
5
6
8
9
1900
267
481
551
378
459
280
285
89
182
130
1910
221
76
172
306
62
0
7
0
69
15
1920
45
84
96
387
894
687 1458
824
457
942
1930
790
886
922 1568 1330 1776
1584
1940
1088
559
869 2024
1578
1950
2238 2629 3954 2987 4158 4382 4652 5528 7796
9335
1960
7530 6699 6037 7084 5761 5489 5481 5852 5326
6815
1970
1990
6703 5635 6147 7946 4950 5751 8317 8115 7064 6261
1001 1522 1343 1079 1275
15524
8675 8062 8503
0
2
3
6
6 8780
8
1499
4 6312 6070 6660 6556 5280 4342 5730 5454 5209
2000
4268 5178 4135 1722
1980
986 1298 1226
450 1280
857 1032
867
688
7
901
36
NS database content: countries
Country
Stations #
1
USSR/RUSSIA
132,081
2
NORWAY
123,740
3
UNKNOWN
68,678
4
UNITED KINDOM
20,408
5
ICELAND
19,808
6
UNITED STATES
15,946
7
GERMANY
11,157
8
DENMARK
5,125
9
POLAND
2,268
10
JAPAN
1,560
11
NETHERLAND
1,416
12
CANADA
1,203
NS database content: station sources
source->stations
16000
15000
14000
Number of stations by source
13000
12000
11000
10000
9000
8000
7000
6000
5000
4000
3000
2000
1000
0
1900 1910 1920 1930 1940 1950 1960 1970 1980 1990 2000 2010
YEARS
ODB_CA [154488]
WOD2001 [83830]
IMR9002 [34730]
AARIod [27634]
OBNINSK [27614]
ODB_ICES [16727]
VEINS_H [14919]
MIKE2006 [11123]
AARI_TGM [7375]
WOD2005 [7233]
AARIcr [5215]
NPICD [3100]
Cearex [2825]
NNDCD [2416]
ARGO [2414]
PNSEC [756]
AWI_CD [731]
MMBI [386]
TRACTOR [313]
OVERFLOW [304]
ESOP [215]
GSP [181]
MAIA [150]
VEINS [113]
NANSEN [10]
CriuseReport [6]
Initial data for this project

Working on the selected data of
2006.
Two different source of data, PF
(Profiling floats) and RV (Research
Vessels).
PF is approx 2980 data and RV is approx
2404 data.
Station position 1.01-31.12.2006 ODB-> Profiling floats (st: 2908)
1.01-31.12.2006 ODB-> Research Vessels (st: 2404) Station position
Objectives



An oceanographic Database (ODB).
Develop a web-based application (Web-GIS)
to display all different parameters in the ODB
system in a browser as a station graph, section
graph or section map without using any
software/tools.
The system will also display satellite images
and forecasts from numerical models on the
same map as ODB data.
What is GIS?



Geographical Information System.
GIS is a computer system for
capturing, storing, checking,
integrating, manipulating, analyzing
and displaying data related to
positions on the Earth's surface.
GIS is used for handling maps.
Projection of Nordic sea:
Selection of development method
and why?

Agile development methods

XP- eXtreme Programming
Selection of technoligies and why?

Database:






MySQL
Other possibilities: Oracle, DB2, SQL Server,
PostgreSQL
UMN Mapserver 5.x (GDAL, OGR ).
Apache Tomcat, Java.
HTML, XML.
Python.
Full package : MS4W for Windows.
Pictorial view of the project:
Request for
data(.ovf)
Request
Client/
Browser
Response
MySQL
MapServer
Map file
Response
data
Application
Server
DB
DISPRO database

Tables:

STATION

P_SALINITY

P_TEMPERETURE

STATION_INFO
Details of table’s columns:

STATION














ABSNUM
STLAT
STLON
STDATE
STTIME
STSOURCE
STVERSION
STCOUNTRYNAME
STVESSELNAME
STDEPTHSOURCE
STLEVEL
STDEPTHGRID
STDEPTHGRIDMIN
STDEPTHGRIDMAX
P_SALINITY
Columns:
 ABSNUM
 LEVEL
 VALUE
 FLAG
P_TEMPERATURE
Columns:
 ABSNUM
 LEVEL
 VALUE
 FLAG
STATION_INFO
Columns:
 ABSNUM









COUNTRYCODE
VESSELCODE
STNUMINCRUISE
PROJECTCODE
INSTITUTECODE
INSTRUMENT
SOURCEUNIQUEID
SOURCEDATAORIGIN
VESSELCRUISEID
Relationship:
∞
1
STATION_INFO
ABSNUM
COUNTRYCODE
VESSELCODE
STNUMINCRUISE
PROJECTCODE
INSTITUTECODE
INSTRUMENT
SOURCEUNIQUEID
SOURCEDATAORIGIN
VESSELCRUISEID
1
LEVEL
ABSNUM
VALUE
FLAG
STATION
ABSNUM
STLAT
STLON
STDATE
STTIME
STSOURCE
STVERSION
STCOUNTRYNAME
STVESSELNAME
STDEPTHSOURCE
STLEVEL
STDEPTHGRID
STDEPTHGRIDMIN
STDEPTHGRIDMAX
P_SALINITY
1
1
P_TEMPERATURE
∞
∞
LEVEL
ABSNUM
VALUE
FLAG
HTML request form
MAPFILE
REQUEST
SERVICE
VERSION
LAYERS
STYLES
SRS
BBOX
WIDTH
HEIGHT
FORMAT
Submit
Result: position located on the map
Expected display on browser (Section Map):
Time series length (years) for latitude-longitude grid net for
salinity.
75
80
70
78
65
76
60
55
74
67
50
45
72
40
68
70
35
30
68
25
66
60
20
64
15
10
62
60
-40
74
5
0
-30
-20
-10
0
10
YearAmount
Database: CLIMATE_v2.IB Computer:ALEX
File: _1_VInd_6
20
30
40
50
60
Challenges :







New types of work.
Work with maps.
Initial problems with software versions
and tool drivers
Time consuming during upgrading
softwares in server
Changing of database many times.
Changing of Platform(Linux -> Windows)
Shortage of literature and web help in
this field
Discussion







XP method realy fits with the project
All new types of tools
Selection of database was crucial
Spatially enabled MySQL
Problems in GUI & took lots of time to fix
it
Version problems & working with existing
software
Started late and working just 6 months
Conclusion


Still have some future work.
Will have opportunity to future
enhancement of the system.
Welcome
Questions?