Been at this company for 4 months as a data engineer. When I started their codebase was a mess. All the code was in one folder with subfolders, the scripts were dependent on one another even if they didn’t share the domain problem, their version control was “call the IT guy to grab the backup”. In the first few months I set up a Github organization for them, put all their code into a git repo to start version control, got them to install and use IDEs instead of just VS Code, refactored some of the codebase to use SOLID standards, automated some tasks, transitioned them to a new Snowflake warehouse, and fixed several issues that was breaking their workflow. Today the CEO told me that this is an at-will state and he let me go. Didn’t explain why, just asked for the equipment back.
I didn’t get any write-ups, no one complained about my work, I was always looking for improvements, even the CEO thanked me a couple months ago for writing a word document to my managers on how I think the team can make improvements. They actually followed that doc and have been happy with it. This came from nowhere because no one brought any complaints. Today I am lost. I just need to vent and let this out.
I did just create an automation project that would scrape/download, clean, and load data from one of their vendor’s websites. I was asked yesterday to write documentation on it so others can use it which would have been done today but…
I was also the developer for a project that reduced their accounting team’s work from 1 month to 1 minute. The project would read accounting reports, download data from a snowflake warehouse, match billing items across multiple reports, and provide a summary to the accounting team. They asked be to help them because it took a month for them to go through each report. I was just finishing the project this week…
I’m a data engineer like you, I create automation scripts to parse and export data to DB. But one thing is for sure, I’ve never made my scripts easy for others to learn. Keep the code a bit messy but it still works perfectly, so they have no a good reason to fire me.