Exploratory data analysis using Python

Open-sourcing Python module for Exploratory Data Analysis, which can be used for any data set

This module has the following sub-functions for the data analysis

1. Getting to know the data
2. Data pre-processing / missing data
3. Crosstable and data validation and visualization
4. Logistic Regression on the data set
5. KNN analysis

How to use it?

1. Please install Anaconda https://docs.anaconda.com/anaconda/navigator/
2. Please install Spider IDE https://docs.spyder-ide.org/current/index.html
3. Download the eda.py from this project repo and a few sample data sets 
4. Run the eda.py in Spider IDE, and when prompted, provide the data file
5. Graphs will be populated in the Plots area in Spider
6. At any point in time, you can exit a particular loop or sub-function by typing 'exit'

GitHub Repo URL: https://github.com/myadavin/eda.py

Also, please check out my other posts related to this subject

• Artificial Intelligence, Machine Learning and Deep Learning for IT Operations
• Cloud Computing and Data Analytics fundamentals
• IT Operations Management
• MTTIC

Work/Study from home (Home Office/Study setup)

Due to pandemic, the new normal for IT professionals is, work from home, OR for the students, Study from home, which means you have to seriously re-look at your home office/study set up so that you can work/study comfortably without compromising your health/productivity/study.

Here are few things, which I have listed, that may help you set up a decent home office/study 

Power backup 

- Invertor - In case your house/flat do not have a power backup/generator 
- Modem UPS OR Small UPS for modem - This is a must for uninterrupted internet connection

- Powerbank for mobile charging, in case you have to take a meeting from other location in your house

Internet

- Broadband (minimum 100 mbps speed)
- LAN Cable - This will avoid any WiFi speed fluctuation and you will get consistent speed. You may have to get clips to fix it as well.

- Set up the Mobile hot spot - This is in case broadband is not working

- Additional Hot spot other than the broadband internet service provider

Home office/study setup

- Well ventilated and illuminated area such as Covered Balcony or near a window 

- Ergonomic Chair 
- Table - If possible height adjustment table

- Optional Sofaset laptop table
- Keyboard and mouse tray - height and angle adjustable

- Spike guard with USB 
- Table lamp
- Laptop stand
- Mobile stand
- Whiteboard, markers and duster
- Pinboard and Sticky notes

- Bookshelf

- Footrest and Anti-skid mat

- Diary and pen

- USB Fan

IT Hardware

- Laptop/Tablet and charger
- Additional Monitor(s) - if you work on multiple applications 
- Speaker 

- Headphone for meetings

- Webcam - If required

- Wireless keyboard and mouse - preferred

- Printer + Scanner and A4 Papers- if required

- Stepler and Punch set

- Adaptors (USB Hub, converters etc)

- External HDD for backup

- Wireless Mobile charger

- Bluetooth headphone for mobile 

- Additional micro USB charger for power bank

Softwares

- Speedtest

- Any other software you want for productivity like to-do/planner etc

Mobile setup / Apps: Setup commonly required office apps on mobile, so that you can operate from anywhere.

- eMail

- Calendar 

- Zoom

- Teams

- Slack

- MS Office (Word, Excel, PowerPoint) 

- Acrobat Reader

- Chrome

- Reminder / Alarm

- Any other tools you generally use in the office

Other

- Yoga mat 
- Fitness watch

- Home exercise equipment

- Work-Life-Study Balance recommendations/suggestions

And here is my home office setup!

Cloud Computing and Data Analytics fundamentals

Cloud Computing and Data Analytics fundamentals 

Suitable for University Students and PhD aspirants

Youtube recorded video link  https://youtu.be/Q01Q1PYtH7o

Cloud Computing

Data Analytics 

Gradual Database Password Rollover for Applications

Gradual Database Password Rollover for Applications

You are not getting downtime for your business-critical or customer-facing application and you still need to change the password for the SoX compliance? so here is the solution, change database passwords without downtime!   

Starting from Oracle Database 21c, we can change the database password without any application downtime.

To explain this new feature, let's consider a simple application running on 3 nodes and load balanced using software of hardware load balancer. 

Typically, in a normal scenario, if you have to change the database schema password, you need to bringdown application services from all 3 app nodes, change the password in the database, change the config password in app nodes (or vault) and start the application services in all 3 app nodes.

Now, you don't need downtime of the application - here is how you can do it.

1) DBA need to associate a profile having a non-zero limit for the PASSWORD_ROLLOVER_TIME password profile parameter, with an application schema. That means, when you are changing the password, your old and new password will be active for the specified time in PASSWORD_ROLLOVER_TIME.

2) Change the config file in all 3 App nodes or vault. Till now, the application will use the old password. 

3) Restart the App nodes one by one (There will not be any downtime to colleagues as, at any point of time during the restart of app services, the remaining least 2 nodes will be serving the requests), once the application is restarted, it will pick up the new password.

Please note that when the rollover time is expired, the old password can not be used. That means, we have to complete all the above 3 steps within the time mentioned in PASSWORD_ROLLOVER_TIME.

So, to conclude, you can adhere to SoX compliance requirements and also keep your business-critical or customer-facing application up and running!

Work-Life-Study balance during and after COVID-19!

COVID-19 has changed the way we work and operate! We are no longer going to the office, which is saving the commute time, however, on the other hand, the number of meetings has increased. Earlier, we used to finish face-to-face discussions in 5 minutes, and now we are spending more time on online calls. This can be a little challenging if your spouse is also working and you have school-going kids as well. Your spouse also has to work, and kids have online classes and submissions. Last but not least, you are spending time in your home, and your home office setup may not be ergonomic as well. In this situation, you may face work-life-study balance challenges.

Work-Life-Study Balance

There are a few things that you can try out. 

Carve out dedicated time for the family, for example, Breakfast time (8:00 AM to 9:00AM), lunchtime (1:00 PM to 2:00 PM), Study time (6:00 to 7:00 PM), and Dinner time (7:00 PM to 8:00 PM). Avoid taking any meetings during these times/breaks. Block this time in your calendar, so that no one can book your calendar during this time.

Segregate meetings into must-have, good to have, and nice to have. Take your judgment on good-to-have and nice-to-have meetings. Try to either reduce the frequency instead of weekly, make it fortnightly, or cancel the meeting series for a few months, etc. You have to attend and participate in "must-have" meetings. 

Segregate your to-do list into 2X2 urgent and important matrix (The Eisenhower Matrix )and try to complete them within the time. 

While dealing with emails, remember 4D's [Do (take action), Delegate, Differ, Delete]. The same thing applies to your calendar as well. 

Take regular time off.

Do meditation and exercise 

Seek help from your friends/manager/mentor.

Eat healthy food, and get proper rest/sleep.

Stay home, and keep in touch with your friends, and family members using video calls/chat

Last but not least, invest in good ergonomic furniture so that you don't get into long-term health issues like backache etc.