Meant to write this earlier in the week but oh well, I learned that dealing with excel in the way that I originally wanted to with pandas data-frame has some kind of issue with working with excel. So I have resolved to using csv style format file. As for writing the code I have the bare bones of it laid out which is basically just writing the request and since the apis have structured their data in json its easy to write a json request. The one area I have completed and that I feel that have completed is getting the dividends and calculating the total dividend payments in a year which I have done by writing a few lines using datetime to get get the current year subtracting one from it so I get the previous year and summing all of the dividend payments made that year. I have also written the lines of code to get the basics of data from some of the end points although I may change these at some point if I feel that there is more data that I want from these end points. I have also written the very bare bones of the lines of code that I will use to append the data to the csv file.
(Stock Data Base)Project 1 Post 1
I have decided on a project to create a data base for myself as a project to figure out the ins and outs of this process. To do this I have decided upon a project that interests me both personally and professionally. So to start this process out I have made a rough outline of what the scope of this project will do and a simple flow chart to help me figure out steps. I have done a similar project in the past but this one will be done by working in file types that I have no previous experience in and in MsSql which I have very limited experience with.
This is my rough flow chart and the scope of my project is this: To create a code/ program in python that combs through api dataset comprised of all stocks in the market and filter them for a few things 1. Do they payout dividends(this keeps cash flowing without the sales of the stock) 2. Do they have a net income or revenue(seems simple why invest in a company that is losing money) 3. what exchange are they in (if they aren’t in an exchange that my broker allows me to trade in then why bother worrying about the stock) 4.do they have a surplus of cash/assets on hand in compared to debt(this is to make sure a company can survive a massive economic downturn or adapt quickly to a major market shift among other things(might consider getting rid of this requirement later, to put it bluntly more data is currently needed on business cases in the face of recessions) 5. Is the data up to date(very simple if the stock data is not up to date then it most likely isn’t relevant/ if it is more recent then the data stored within the file already then simply amend the file data of the specific stock) if the data passes these steps then it will be added or amended. This will be done in a while loop to make sure that it combs through the entire stock list available. The information I will save will be 1,stock symbol, 2. full stock name, 3.date, 4. the exchange its listed on, 5 industry, 6.sector, 7.net income, 8. cash on hand, 9. price, 10.dividend, 11.dividend as a percent of price(((div*dividend periods)/price)*100) The file type will be either a csv or excel(more data is needed by me to understand which is better for my purposes) It will be linked and be the basis for a mssql database as I will sort this data in mssql and might later add more relevant data to compare against such as gdp growth data from the U.S. Bureau of Economic Analysis by the U.S. Department of Commerce.