acloudtree

Category Web Design

Let my dataset change your mindset

If you follow the link provided. It will take you to a brilliant video by Hans Rosling. My hope, is that anyone watching at least begins to understand the power of data. Maybe not the exact method to manipulate the stuff, but at least the desire to know more about it.

This video is quite timely for me. For I have thought long and hard about putting together a series of posts on data analysis. Particularly on the work I have done in looking at the Deschutes County Clerks Data.

For those of you who don’t know. In the fall of 2007 I created a program that went to the county website and would pull public records and sales data concerning housing. It would throw this data into a usable database.  And I would use this data to educate family and friends on when our housing bubble was started, and how bad it really was.

I built a small website with this data, but stopped my work on it because of several complex reasons.

Anyway, if people are interested in how to analyze data, or would appreciate an ongoing conversation about it, let me know.

Beginning Cakephp – Errata : Pg 106

The findByYear() function is messed up in the book. Thought I would post the correction to remind myself.

Correct!

function findByYear($year=null) {
	$date = $year.'-01-01 00:00:00';
	$end_date = $year.'-12-31 23:59:59';
	return $this->find('all',
		array(
			'conditions' =>
			array(
				'DATE(Post.date) >' => $date,
				'DATE(Post.date) <' => $end_date
			)
		 )
	);
}


Incorrect!

function findByYear($year=null) {
	$date = $year.'-01-01 00:00:00';
	$end_date = $year.'-12-31 23:59:59';
	return $this->find('all',
		array(
			'conditions' =>
			array(
				'DATE(Post.date)' => '>'.$date,
				'DATE(Post.date)' => '<'.$end_date
			)
		)
	);
}

www.redb.org

So I started telling people about my little data scraping website. It is cool that something I have been devoting my free time towards for 9 months, is now finally coming to light. I am really excited to see what feature requests I receive from users and where that leads the development of the site.

http://www.redb.org

-peace

Google Maps and large data sets…

I am in the process of scraping data off of a public records website. The records consist of property sales information. Something that I have been working on, is taking the addresses in these records and use geocoding techniques to gather their latitude and longitude coordinates. I can then use the LAT/LONG coordinates to create custom Google maps.

I ran into two major setbacks though…

My first is that the coordinates are a bit off. I looked at both geocoder.us and what Google offered and found that the accuracy is not amazing. I am going to go look at Yahoo’s! geocoding service and I will update with what I find.

Second, some of my maps upload over 400 different LAT/LONG coordinates so that I can mark entire subdivisions. Unfortunately, I am finding that this makes the map CHUG! So I am investigating how to prevent this effect using different techniques.

I will update this post once I find some answers that work.

UPDATE #1: So I have tried a sampling of all the data just to see how it looks and so far I am not impressed. The accuracy is quite off.

Copyright © Jared Folkins
Programming, Computers, Writing, Economics, and Life

Powered by WordPress