Documentation A5

Exploring Datasets and Practice on 311


World Happiness Report

I've seen other datasets from Gallup World Poll before and was interested in how it quantifies happiness and its parameters. Here's the details of this dataset:

    Collector/contributor:  United Nations
    Purpose: Happiness Indicators to inform government's decision makings
    Collection Method: Data are collected from Gallup World Poll
    Dimensions: 156 lines(countries), 12 columns

The dataset quantifies happiness of citizens from different countries from a macro perspectives. It combines individual polls and objective statistics. It's convenient to use machine learning and do a regression to estimate the correlation between Happiness and each parameters(GDP, life expectancy, etc..)

311 p5 sketch exercise

https://editor.p5js.org/roger1mjh/sketches/ZG2BkJS07


Originally I want to make some edits on the existed code to conduct a different use of the simplified 311csv and get to understand the codes. I noticed there are different types of noise complaint a lot. Therefore I focused on noise complaint.
As for the other inputs parameters, I think agency is a bit useless because almost all complaints of the same type are dealt by the same agency. After I got rid of "agency", I simplified borough and community by ZIP code, thought it would be a clear representation.
Moreover, I edit some HTML code in the index because it matters to the interface. And I used list instead of type input for complaint type, because it's more intuitively.

It runs as I expected, without any error. However, there's a big issue. The prediction value is almost always the same, no matter how I change the parameter and noise type. It doesn't seem like a bug here. So I downloaded the csv file that Lydia simplified and inspected it. I found many of the ZIP code only have few lines of report, and none of them are noise reports. Therefore, I assume the problem of my code is because the inputs I chose to use, which is Incident Zip, is not diverse/representative enough.
In response, I replaced Incident Zip with Borough. And it fixed the problem.


    
    

Comments

Post a Comment

Popular posts from this blog

Assigment 4

Image
 Image Transfer on P5 Response to Dr. Fiebrink's Speech: There's one part in this speech that intrigues me the most, which is using Machine Learning in creative works does not need to be smart and delicate. It is OK to be dumb and funny, because that's what an unmatured technology genuinely looks like, and it can still be creative. The Edges to Cat example is so fun to play with that I'm kind of addict to it.  Attempt to do Image Transfer on P5 with Pose Regression I watched the videos posted and was most interested in the pose regression example. But the RGB value shift looks not "machine learningly" enough, because it's possible to make some similar project without neural network. Therefore I tried to make one with image transfer. Firstly, I need to load image in data format in P5. I decided to try pixels first, because they retrieve and store image data directly. Then I console logged the "pixels" object in draw, to test out how much the data ...
Read more

Assignment 2A

Image
2A: Excavating AI, Teachable Machine Project Jianhao Ma Moral Machines The reading "Excavating AI" brings up an idea that the tasks of training AI should not just be making them smarter, but to apply political consideration and moral standard as well, especially when related to people. I would not care about such idea years ago, because I thought that technical breakthroughs is the one and foremost priority in emerging technology industries, why bother? However, when the application of machine learning started entering our lives, I changed my mind. Everyday, there are many information processed/filtered by machine learning tools being fed to us, textual or non textual. They could be the advertisement you watch on social media, the pop-up news on your phone. In other words, many of the lower products of machine learning are mediums. Therefore, they have the inherent nature of being political biased and ideologically influential. The fantasy that "technologies should be un...
Read more

A9 - Draw my Drum Machine

Image
My Box Sequencer and Circle Visualization A Dumb GIF illustration: I just followed the steps we learned in class and stylized the box sequencer a little bit by shrinking the size, add strokes, and changing colors. Those were the easy part. Then I recalled that Luisa encouraged me to try making a circular sequencer with arc(x,y,w,h,start,stop). I felt confident about it because I've used arc several times in P5. However, when I actually coded it, I found it's more complicated than I thought.  The first difficulty assigning orders. At first the bigger arc overlapped the smaller ones and hided them underneath. I fixed that through changing the w and h from adding up to decreasing down.  The second challenge was the mousePressed function. It's doing not simple math with mouseX, mouseY, and w anymore. In order to make it work, I have to create a class of arcs and assign the arcs that represent each drum note to objects of that class. It's too much labor to do ...
Read more