caprenter’s gists

caprenter / scraper.py

Created November 14, 2018 22:47

	import pandas as pd
	import numpy as np
	import matplotlib.pyplot as plt
	import seaborn as sns
	%matplotlib inline

	from urllib.request import urlopen
	from bs4 import BeautifulSoup4

caprenter / gist:3fcc114c64d1d42ef443

Last active December 11, 2015 15:53

test json

	{
	"license": "https://creativecommons.org/licenses/by/4.0/",
	"packages": [
	"https://www.contrataciones.gov.py/datos/doc/planning/203326-adquisicion-numeradoras-tipograficas.json",
	"https://www.contrataciones.gov.py/datos/doc/tender/203326-adquisicion-numeradoras-tipograficas.json",
	"https://www.contrataciones.gov.py/datos/doc/award/203326-adquisicion-numeradoras-tipograficas.json",
	"https://www.contrataciones.gov.py/datos/doc/contract/203326-molman-s-a-1.json"
	],
	"publicationPolicy": "",
	"publishedDate": "2015-12-10T09:06:36-0300",

caprenter / gist:e684dc5098bdc7bbc694

Last active August 29, 2015 14:22

Fields Mismatch 360 - example

	Standard fields used: paul-hamlyn-foundation-grants.csv
	Amount Awarded
	Beneficiary Location:Name
	Currency
	Funding Org:Identifier
	Funding Org:Name
	Identifier
	Planned Dates:Duration (months)
	Recipient Org:Identifier
	Recipient Org:Name

caprenter / gist:1db7f68e92b02a46baa1

Last active August 29, 2015 14:21

	Resource Projects Data Model

	Requirements

	ResourceProjects.org needs to be able to accommodate data coming from a wide variety of different sources, and to use this to:

	Identify projects;
	Link as much information as possible to those projects;
	Key challenges to be addressed include:

caprenter / groups

Created May 13, 2015 12:22

Grouping NRGI

	<caprenter> year Date
	<caprenter> latitude Location
	<caprenter> commodity What is being extracted
	<caprenter> country Location
	<caprenter> longitude Location
	<caprenter> no_sk / license number? Identifier
	<caprenter> units What is being extracted
	<caprenter> nama_perusahaan / company name Identifier
	<caprenter> mm
	<caprenter> maininvest

caprenter / drc1.ipynb

Created May 13, 2015 10:02

DRC

Sorry, something went wrong. Reload?

Sorry, we cannot display this file.

Sorry, this file is invalid so it cannot be displayed.

caprenter / gist:6697816

Created September 25, 2013 10:30

My count of years for activity date

	Standard fields used: paul-hamlyn-foundation-grants.csv
	Amount Awarded
	Beneficiary Location:Name
	Currency
	Funding Org:Identifier
	Funding Org:Name
	Identifier
	Planned Dates:Duration (months)
	Recipient Org:Identifier
	Recipient Org:Name