-
Introducing Popular ETL Tool
As a person working in the data science industry for years, I have experienced with 6 different ETL tools for project implementations. For handling a new tool, I think it is likely for 3 working days to pick up the basic skills for implementation. Here’s an introduction to several popular ETL (Extract, Transform, Load) tools…
-
Journey to Becoming a Data Scientist: A Comprehensive Guide 2023
Introduction: In today’s data-driven world, the role of a data scientist has gained immense significance. Data scientists play a pivotal role in extracting valuable insights from vast amounts of data, driving business decisions, and solving complex problems across various industries. If you aspire to become a data scientist, this article provides a comprehensive guide to…
-
Maintaining Health and Well-being During Long Office Hours: Essential Tips for Every Individual
Introduction: In today’s modern work environment, many individuals spend a significant portion of their day sitting in front of computers, leading to potential health issues. Prolonged sitting, poor posture, and repetitive tasks can contribute to musculoskeletal problems, eye strain, mental fatigue, and overall sedentary lifestyles. This article aims to provide practical suggestions for individuals to…
-
5-year Strategic Plan on Data Science Development
This guideline is based on my personal experiences in tens of data analytics & data science projects and consulting works for the last decade. It should be fit for different organizations including corporations, non-profit organizations and institutions. Here is my suggestions on possible actions throughout a 5-year periods: Year 1: Building the Foundation…
-
Importance of Real-time Data Analytics
Real-time (or better say near real-time) analytics make sense of all the real-time data that passing around an organization. Once a business is able to analyze data in real-time, they can generate insights during data streaming instead of storing and analyzing it in batches. Traditionally, data analysis happens once the data has been captured and…
-
Importance of Primary Key
I have been working with relational database, NoSQL database and Hadoop HBase for years mainly for storing data for analysis. There is a fundamental problem for people still overlooking the importance of primary key in a table. In this article, I would like to go through the detailed information about primary key such as: definition,…
-
Career Opportunity
My team (SDI) is hiring the position of Assistant Data Engineer (trainee) based in Hong Kong. It is an opportunity to develop your data science career. Our client includes: Fortune 500 Government Departments Listed Corporations Statutory Bodies and … many more Please check the job ads: LinkedIn: https://www.linkedin.com/jobs/view/122773078/ WWW: https://smartdatainstitute.com/jobs
-
A Low Cost Data Repository for Data Science Project
In the past month, I have made a number of research and testing on different data science technology including on-premise and cloud solutions. They are: Google BigQuery, Cloud Storage, Airflow Qilk Sense, Data Streaming (CDC), Data Warehouse Automation, Data Lake Creation Debezium CDC EnterpriseDB, GaussDB (by Huawei) In the coming future, I will share some…
-
Different Stages in Data Science Team Building
In general, there are 3 stages of building a data science team. Early Stage Mid Stage Late Stage (Mature Stage) For each stage, the team structure of a data science team should be different in order to meet the needs within the business or organization. Organizational Models Meanwhile, there are 3 different types of Organizational…
-
Five Ways to Build a Data Science Team for your Organization
As a data science consultant for years, I would like to share my viewpoints and experiences of developing the capability for a data science team for any organization. (NOTE: this article is aimed to share building data science for general business. However, it is not for helping you to build a Data Science consultancy or…