Here is an updated machine learning pipeline for my project.
Submitted the CS second draft on Wednesday and waiting for Xunfei’s Feedback. The demo presentation went well without much questions from the audience. On working on making the poster for the presentation on Dec 5.
I met with my mentors 3 times to discuss the proposal’s feedback and what I can do to improve it. I also reached out to some folks whose previous work could help me. I decided on my end product as … Read More
This week I have been reading some published papers that use the same dataset as the one I use for this project. My purposes for doing this are to know the conclusions other people have made using the dataset and … Read More
This week I did a lot of research into how jitter works and how it communicates with max and msp objects. In the process I found a few more helpful sources to replace some of the less relevant related works … Read More
A much slower week than normal, I was swamped with a number of other pre break assignments so I wasn’t able to put much work into reading or revising this week. But I was able to work on revising my … Read More
Met with Ajit to talk about the follow up steps on Monday. Based on the feedback, we decided to focus efforts on the following: Updating the design framework/diagram, Writing and explaining the design of the project, Read other published papers … Read More
After reviewing my literature review and the papers I have read previously in detail, I found out that not many researchers predict stock prices but instead they just predict the price trend (whether up or down). Thus, I have been reading … Read More
During the past week, my focus has been on: Preparing for the demo. Working on the second draft of the paper. Manually labeling the corpus. Working on getting the overlapping tests working. Outlining the poster.
During the last week I encountered a few problems with my project While working on the demo, I noticed that the classifier is not doing a good job classifying liberal news sites. It classified a few articles on CNN and … Read More
I have been reading up on documentation and research for the Leap Motion controller so that writing the code will be more easily managed in the future. I have also been updating the commented portions of my proposal, and I’m … Read More
This week I worked more on my proposal after I received constructive feedback from Xunfei. I explored some of the papers further in depth to learn about how to design my project. I am also researching on what tools to … Read More
Worked on the demo presentation. Experimented with 2 datasets each taking 4 hours of run time. One observation I found is that changing the labels of the fake news changes the accuracy. It was found that detecting reliable news rather … Read More
This week I made some minor changes to the python script so now the generated file is in the right format. I also made some major changes to my paper and have an updated draft of it. Next week I’ll … Read More
During the last week, I mostly continued working on getting the exhaustive parameter search working for the classifiers. At first, I was having a few errors but in the end, I was able to get it working and get results. … Read More
My proposal adviser will be Dave. We met last friday to talk about my project idea. one note he gave me was to be clear what parameters I will use to measure my success since my project is almost completely … Read More
Did second pass for more papers for this week, focusing on the design, and processes used, Met with Ajit on Monday to discuss the project and plan rest of the semester, Took Quiz 5 for Project update.
My adviser for my project for the remainder of the semester is Charlie Peck. We met on Tuesday to discuss my weekly plan. Over the next 4 weeks I will be building the database from the source code, which includes … Read More
Found an advisor, Ajit, and scheduled a meeting. Otherwise did a second look at a couple papers I had only done a first pass on. Otherwise waiting on feedback on my first draft and spent a little time looking at … Read More
This week, I met with Craig, and discussed what kind of tools I need to purchase for the project, such as RFID reader and Tags. There are many options however, I need to make sure to purchase a reader that … Read More
During the past week I was able to: Improved the average accuracy, recall, and F1-score of my MLP classifier to 80% Implemented goose3, a news scraping API to query raw texts from news articles, handled the data, vectorized the sentences … Read More
This week I asked Dave to be the advisor for my project. Dave suggested that I could explore the project in more ways such as having other ways to determine the similarity between two users and seeing what would work … Read More
This week I met with Seth Hopper concerning light pollution on campus and different ways to measure that, so I have some ideas to test. I was introduced to some of the fire department’s devices to measure air quality, which … Read More
This week I re-structured things again. I decided to look into other methods of generating a visualization and decided to separate that process out from NVDA. Under this design, the developer runs NVDA with my plugin installed and that generates … Read More
The front end development part for my project is almost complete. The database setup and connection is completed. The integration of backend machine learning model with flask has worked. The flask prediction model has also been linked with the frontend. There … Read More
I read more papers where the researchers used a Leap Motion controller to recognize gestures. People use a variety of methods to classify static and dynamic gestures. One of the more frequently used methods takes advantage of a ‘Hidden Markov … Read More
I have been reading more recent papers on the topic, and I came across with the paper recently published (Oct 22nd, 2018). The paper is called “Predicting Chinese Stock Market Price Trend Using Machine Learning Approach.” In summary, they … Read More
This week, I met with Xunfei to talk about my project and have been working on finishing the first draft of my proposal. Now I will plan on having a 4-week plan and find a advisor for my project to … Read More
This week I accomplished these tasks: -found the rest of my 15 sources for my paper -Met with Xunfei to discuss my design outline -wrote my project proposal -Did a second pass of a few of my papers
Worked on my final paper some more, as well as familiarizing myself with my two-node blockchain set-up. I’m still working out how to integrate my other modules into the system, particularly how to pass a function from one server to … Read More
This week I just worked on writing the first draft of my proposal. Found several additional papers to bring myself up to the requirement and fleshed out my idea for what I want to do in a bit more detail. … Read More
Did second pass for three papers for this week, Worked on First draft for proposal.
This past week, I did my literature review presentation and got caught up with class assignments. I also created a framework for my project and obtained the Arduino air pollution sensor I will use so I can start testing that. … Read More
For the first half of the last week, I was working on the first draft of the paper. Since then, I have been working on getting the exhaustive search working. It has been a struggle. I was trying to implement … Read More
I worked on the first draft of my topic proposal for the past week. I decided to evaluate stock predictive models by ANN and SVM based on three different metrics: accuracy, closeness, and trading simulation. Five years of data of … Read More
During the past week, I have been working mostly on the Google Chrome extension. I encountered some problems with scanning data from a given website. The extension listener does not seem to process DOM objects correctly and it couldn’t query … Read More
At this point, since I’m still having issues with DrawString, I decided to start looking into alternative options. My adviser recommended that I look into Tkinter again, but after some playing around with it and digging into it, I learned … Read More
Worked on completing the frontend. I have decided to use my local machine for hosting flask and have made progress on the backend. I still need to fix Database issues but progress this week has been significant. I have just … Read More
I have decided to go with the Database Akumuli. My reasoning behind this is both because of the index structure it uses along with it’s documentation. This data base clearly states in the README that it uses a combination of … Read More
I reviewed more papers over the week to get a better sense of what I would need to address in my proposal. I also met with Xunfei and discussed the structure of my project as well as how to work with … Read More
Worked on the front end component of the project. With the sys admin telling me that they cannot host flask for my project. I started to look for alternatives. Heroku could not be used as it did not provide support for … Read More
During the past week, I have mostly worked on the first draft of the paper. I did a quick review with Dave on Monday. Then, I reworked on the paper based on the suggestions from Dave. I have also worked … Read More
I reviewed the papers I read for my literature review, and also I collected more papers to read for my topic proposal. Since I would like to focus on the evaluation of existing machine learning predictive models, I do not … Read More
Did second pass for three papers, posted on the box, Took Quiz 4 for CS388, Chose 3 papers for next week.
I have successfully set up a blockchain system, and run experiments to familiarize with how it works and the involved processes. My first draft of the paper is mostly complete and will be ready by the deadline tonight. It will … Read More
In the past week, I was finally able to get my MLP classifier to train and test with the IBC dataset without any error. The average result so far is at 66% with a standard-parameterized MLP in sci-kit learn. In … Read More
I found this function to create a font and played around with it until I had a version that was recognized by the GdipDrawString function. Now I have code that compiles without errors and causes no runtime errors, but the … Read More
For this week, I have been mainly working on my proposal for the project. I have been writing the introduction to my proposal and drawing up diagrams to make my project easier to understand. I also reviewed my paper about … Read More
I have been taking notes and learning about different tree indexing structures. I currently have 6 pages of notes and understand How R trees work and how X trees uses techniques from both R trees and B trees. I need … Read More
After filtering through many different project ideas, I finally decided to create an aesthetically pleasing data visualization of pollution on Earlham’s campus. I have written a literature review of 15 sources on all of data visualizations, artistic factors that influence … Read More
This week I finished writing the literature review and looking in depth into the literature available for my two topics: RFID in library and Sentiment analysis for stock prediction. I believe I will proceed with RFID technology and research more … Read More
Finished the machine learning pipeline with actual experimentation. Having issues getting Flask setup and have been in touch with the SysAdmins. Halfway through the first draft of the paper. Made new design for the system architecture.
Finished literature review. Selected 1 topic from the remaining two for Quiz 3 (proposal)
I am still in the process of writing my literary reviews. I have completed one and the second I am currently outlining. I am learning a lot of new information with my new sources. Since I know which of the … Read More
This week I filled out the quiz and started looking into what resources I’ll need for my project, image stitching. At the least I’ll need openCV, but probably imageMagick as well. Starting to think about how I should organize my … Read More
For the past week, I have been looking at some available corpora found online. I was able to get one for free, namely the Open American National Corpus. It seems like it might be a better fit than the Blogs … Read More
Last week I was able to set-up a two node blockchain on the Earlham Cluster, after working through technical issues with the help of Craig. However, I discovered several problems with this structure this week. I couldn’t re-access an already … Read More
This week I dedicated my time towards designing my proposal idea. After my literature review I decided I wanted to continue my audiovisual project. I read through the documentation for the jitter programming language to see what would be feasible … Read More
This week I’ve focused primarily on drafting my final paper. So far I have a general outline of my paper (abstract –> introduction –> related work –> framework and design –> implementation –> conclusions and future work), and I’ve fully … Read More
During the past week I have: – Cleaned up the data, converted it to the CSV file, tried feeding it to the MLP classifier. However, I’m running into some error scaling it before feeding the data to the MLP. I … Read More
This week I’m focusing on my project, which is to build a method for building music recommendation using collaborative filtering. To do that I am currently reading papers about collaborative filtering in more details and comparing different techniques for collaborative … Read More
After reading more about literature on stock prediction with sentiment analysis, I came to the conclusion that it is very difficult to obtain text data that is relevant for my research for free. I looked at Twitter streaming API and … Read More
I did an experimentation with Sci-kit Learn. The run-time for the program was more than 2 hours. Testing the multiple dataset has been an issue lately.
Progress on the draft of the paper. Related works is almost completed.
This week I am writing my literary review for Indexing Time Series Databases. It is going well. Because this is an area that has been researched for over two decades there is a lot of background information I will be … Read More
This week I made good progress in my research. Here are some of the things I have done: -Met with Forrest Tobey to discuss his past research involving motion tracking virtual instruments as well as visual capabilities of the Max/MSP/Jitter … Read More
For the past week, I worked on literature reviews on two topics: stock prediction with natural language processing and stock prediction with machine learning. One of the most important findings is that each researcher used different datasets to predict different … Read More
Making heavy headway into literature review, but still adjusting to overleaf. My final topics are predicting matches in the premier league, and making a software that combines several CV methods in a robust wrapper for easy use. Found eight sources … Read More
Started 2nd pass for the papers. Continued work on literature review.
Last week I was having a problem with a deprecation warning. I looked into that and I thought I fixed it. It seemed to be working fine, but I got the same error at a different point. So I am just … Read More
This week I started playing around with creating the visualization tool piece of my project. In doing that, I learned a lot of the more finicky details of NVDA. It uses an internal installation of Python, which makes sense for … Read More
During the past week I have: – Gotten close to getting the data to work. Right now the data is divided into leaves and nodes. I’ve been able to get the node-level labels but not the leaf-level labels. Once that … Read More
For this week I am working on the literary review for the two projects that I’m most interested in working on. I am also reading more papers related to my topics.
Worked on the first draft of the paper. Focusing on the related works and findings currently.
For the past week, I did the second reading for the 15 papers for the annotated bibliography and also prepared the presentation for the class. I narrowed down my topics into two: stock prediction with sentiment analysis and stock prediction … Read More
After talking to Ajit about the problems I have been running into with my virtual machines I’ve made the decision to switch to using the Earlham servers for the purpose of running my experiments and collecting data. There’s only one … Read More
Finished bibliography. Selected two topics and prepared topics presentation. Started literature review.
In the past week, I have been working on the related for my three project ideas. I wrote an annotated bibliography for each topic with five different sources. This week got rid of one of the ideas and decided to … Read More
Prepared a presentation for class on my final two topics, image stitching and predicting premier league games. Started searching for additional topics so I can meet the 8 requirement for the imminent lit review.
I found some quirks and issues with the way NVDA works in different settings. I can now get a transcript with the appropriate details by using object review mode in Firefox, but not by navigating the objects normally or while … Read More
During the past week, I was able to query the data from the IBC and looked more into it. It has come to my attention that the IBC was labeled both on the word level (leaf) and the sentence level … Read More
Continuing from last week, I was able to change the implementation of the Scikit-Learn wrapper for TSVM from Python2 to Python3. I am currently getting a new deprecation warning caused by TSVM. It seems like the code for TSVM assumes I … Read More
Build a rough machine learning pipeline for testing. Worked with Ajit to update timeline. Started with the first draft of paper.
I am certain at this point that I will be going in a direction where I will be doing research on a database. My first thought was to explore how to store Tree Data Structures in Postgresql. Which led me … Read More
For my project, optimizing an AI agent for Dungeon Crawl Stone Soup, I’ve recently changed the scope of my project somewhat. Instead of trying to improve the AI agent’s chance of winning a game of DCSS, I’m now working to … Read More
Nothing much to report, worked on my annotated bibliography and am narrowing down my interest to just two of my three ideas. Currently leaning towards 2d stitching, potentially expanding it to include some 3d point cloud work as well, but … Read More
I’ve laid down the bare bones for my thesis paper. With the main project however, I am running into problems with my virtual machines and blockchain code, rather I keep running into problem after problem with them. I plan … Read More
Continued working on Annotated Bibliography: Found more papers on the topics, Did the first pass reading for all of them.
There is no big update on my work for the past week. I will be working on the annotated bibliography due this Friday.
For this week I have been reading the research papers that are relevant to my topic and take notes of them. I still need to work on narrow down the scopes of my topics as a couple of them may … Read More
During the past week I have: – Started writing the introduction of my thesis paper – Started implementing the first module of the project (word matrices initialization) – Looked into the IBC corpus data, whose sentences are implemented as a … Read More
This week I’ve gotten minorly stuck. I know that NVDA is able to grab — and speak — certain information about the data visualizations I’ve created(it might say, for example, “graphic New York” when I navigate to a point representing … Read More
During the past week, I run into a few problems. I kept getting a PendingDeprecationWarning coming from one the methods used from Scikit Learn. It seems that something has changed or is currently changing on Numpy that affects Scikit learn modules. … Read More
Created a smaller dataset using pySpark for training and testing the fake news model.
I’ve been researching Voronoi graph regions and their usage in recommendation system. I’m particularly interested in finding open-source implementation of Voronoi graph regions usage. I’ve also been reading and researching FiveThirtyEight’s gerrymandering maps and how they created their maps of … Read More
Read the papers and summarized them. I am leaning more towards the gesture control system idea, but at the moment it seems like I keep finding more and more challenges to overcome with this project. Typing with gestures may not … Read More
For my senior project, I’m working on optimizing the performance of qw, an AI Agent developed to play (and sometimes win) the game of Dungeon Crawl Stone Soup. To reduce the search space and make optimization with machine learning faster, … Read More
My project ideas have been evolving since starting to research articles. My main fields of research have been in audiovisual synthesis, motion control for virtual instruments, and algorithmic music composition. I have found lots of articles including a good one … Read More
Met with Andy Moore and talked about projects regarding natural disasters. Realized that many of the ideas were too big for a semester, and started researching in Earthquake Early Warning systems Worked on Quiz 2, and collected papers for each … Read More
Realized two of my ideas don’t really work at all and so I need to search for new ones Learned that I really need to work on something I’m interested in because if I’m not it’s going to be hell … Read More