This week we worked on getting all together for the presentation with the teacher. Mike developed a basic database connection that allowed us to get the tweets Alex and I were mining and store it in a MySQL table that will be the bridge to analyze stuff later on and clear the information, do the sentiment analysis and determine if the tweet belong to the candidate.
Alfonso worked on implementing all the unit testing of some basic arithmetic functions. We are still learning about the unit testing so it will take us some time to adapt to a test our functionality there.
The weekend I worked on the Makefile of the project so everybody can install dependencies and the devOps work is fully done with space for test, install and run the project in developer mode and in production.
This was hard for me because I needed to be sure that it worked in both Unix and Windows systems, so I tested it in MacOS, Ubuntu and Windows.
There’s still more work to do this week because everything is already installed but for the first delivery we plan to finish the integration of the API with the streaming tweets and saving them in a temporary local database so we can ensure that later on we will be able to process the data and store it in any service the other team decides.
So for this week my personal tasks I want to make is the easy connection with the API with a good python interface that handles the data correctly asynchronously.
This week we worked on the implementation of the script that now fully works in the environments of all the members of the team. Each member has its own Twitter API keys so we don’t have to hardcode the private keys.
We came out with a full architecture of the project this week and this is the result:
This a 2 part project so we are gonna focus on the left side of the python micro-services that save the processed data into the database.