EasyDataTools
Repository with friendly workflows in Jupyter Notebooks to work with mainly wellbore datasets from Norwegian Petroleum Directorate (NPD, public data, API).
Install / Use
/learn @AnneEstoppey/EasyDataToolsREADME
EasyDataTools
Repository with friendly workflows in Jupyter Notebooks to work with mainly wellbore datasets from Norwegian Petroleum Directorate (NPD, public data, API).
Geospatialisation - Interactive map with Folium
In the following notebook:
/notebooks/interactive_map_Folium.ipynb
we will create an interactive map with Folium. We worked with clustered markers, layers which can be switched on/off, and added a fullscreen button.
The datasets are shapefiles coming from the Norwegian Petroleum Directorate, which is public data, and can be found here. We used the wells and the production licences shapefiles.
This is a first version of this notebook, and we hope to add more functionalities in future.
<br> <img src="https://user-images.githubusercontent.com/35219455/236474838-f90d137a-03aa-4751-9dec-780b09379490.jpg" width="700"> <br> Open Folium map notebook in nbviewer here: (you'll have to run the notebook to display the map) https://nbviewer.jupyter.org/github/AnneEstoppey/EasyDataTools/blob/master/notebooks/interactive_map_Folium.ipynb.<br> <br>NEW: we have created a web app with our folium map which is in the following repository: https://github.com/AnneEstoppey/flask-folium-app
Geospatialisation - Mapbox
In the following notebook:
/notebooks/geospatialisation_well_data_norge.ipynb
we will work with both the Exploration wellbore and the lithostratigraphy datasets from Norwegian Petroleum Directorate (NPD). The wellbore datasets are public domain. They are available here. We will use the API connection to get the datasets <br> <br>
Description of the different data 'wrangling' steps:
-
Get the Exploration dataset, select columns and the wells for North Sea and Norwegian Sea only.
-
Get the lithostratigraphy dataset which has information about Formations and Groups for each well (including top and bottom depths). Select specific columns and only North Sea and Norwegian Sea areas.
-
Merge a selection of columns from the Exploration dataframe together with the lithostratigraphy dataframe.
-
Add Geological age in the merged dataframe.
-
The resulting is a dataframe for all Explorations wells in North Sea and Norwegian Sea, with Formation, Group and Age for each row. Each row also has coordinates, which will allow us to export to a point SHAPEFILE and examine our dataset in a geospatial context, here we are using MAPBOX.
Display in MapBox - wells with Triassic
Click HERE to open map in MapBox. <br> <img src="https://user-images.githubusercontent.com/35219455/236475329-e8dea051-c471-4fee-ade4-57b83f18f9c8.jpg" width="700"> <br>
Visualisation - wells stack bar graph
In the following notebook:
/notebooks/well_data_norge_API_altair_graph.ipynb
we will work with the Exploration Wellbore Dataset from Norwegian Petroleum Directorate (NPD). The wellbore datasets are public domain. They are available here. <br> <br> We will generate several stack bar graphs, using the ALTAIR library. The graphs will show us:
- Status of all Exploration wells on the Norwegian Shelf since beginning of exploration, by year, number of wells and well content (oil/gas/condensate or any combination)
- Status of Exploration wells between 1980 and 2020, by region: NORTH SEA, NORWEGIAN SEA and BARENTS SEA
We wished to make this notebook easy to follow so that anybody could understand the different steps of data wrangling to finally the stack bar graphs. We hope you enjoy its simplicity! <br><br> <img src="https://user-images.githubusercontent.com/35219455/236475565-76edaac0-e9f4-4cf1-bba9-4dbd462fd03e.jpg" width="900">
Related Skills
node-connect
351.8kDiagnose OpenClaw node connection and pairing failures for Android, iOS, and macOS companion apps
frontend-design
110.9kCreate distinctive, production-grade frontend interfaces with high design quality. Use this skill when the user asks to build web components, pages, or applications. Generates creative, polished code that avoids generic AI aesthetics.
openai-whisper-api
351.8kTranscribe audio via OpenAI Audio Transcriptions API (Whisper).
qqbot-media
351.8kQQBot 富媒体收发能力。使用 <qqmedia> 标签,系统根据文件扩展名自动识别类型(图片/语音/视频/文件)。
