Data Analytics and Video Tutorials
In our previous post on how to compare CSV files for differences we showed how you could see the differences, but what if you wanted to see if a record was 100% matched or not? Here we are going to use SequenceMatcher which is a python class that allows you to compare files and return…
Read More “How to show percentage differences between files in Python” »
Often a lot of data analytics projects involve comparisons, some of it could be to look at data quality problems, other times it could be to check that data you are loading has been saved to the database with no errors. As a result of this, there is a need to quickly check all your…
So you have numerous different automation projects in Python. In order to ensure a clean and smooth straight-through processing, checks need to be made to ensure what was received is in the right format. Most but not all files used in an automated process will be in the CSV format. It is important there that…
Read More “How to Compare Column Headers in CSV to a List in Python” »
In many of the SQL programming softwatre tools, there will most likely be an option for you to import your data torugh a screen they have provided. In SQL Server Management Studio the below screen is available to pick your file to import, and it quickly guides you through the steps. But what if you…
So you are working on a number of different data analytics projects, and as part of some of them, you are bringing data in from a CSV file. One area you may want to look at is How to Compare Column Headers in CSV to a List in Python, but that could be coupled with…
Read More “How to count the no of rows and columns in a CSV file” »
Problem statement You are working away on some data analytics projects and you receive files that have incorrect headings on them. The problem is without opening the file, how can you change the headers on the columns within it? To start off, lets look at file we want to change , below is a screen…