3 Tips For Staying Positive During A Holiday Job Search

Popular 3 Tips For Staying Positive During A Holiday Job Search Ariella CoombsJenna ArcandDecember 06, 2022 Bigstock {"adCodes": [{"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 0, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}, {"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 1, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}, {"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 2, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}], "adsOrder": [2]}

Don't let your employment status dictate how much you enjoy the holidays. This is a time for happiness, family and friends, and delicious food!

I mean, c'mon. There's no reason why your job search should interfere with Grandma's famous pumpkin pie. But it can be hard to stay positive during the holidays when those aunts and uncles are nagging you about your job search and old friends are asking what you're doing for work these days.

It can be so tempting to completely remove yourself from holiday festivities so you don't have to experience that agonizing awkwardness of answering the same dreaded questions over and over again. Don't let your insecurities ruin the most wonderful time of the year. Here are our three tips for staying positive during your holiday job search:

1. Don't Allow Yourself To Feel Sorry For Yourself

via GIPHY

You don't have time for that pity party nonsense! You've got to bake cookies, play with your dog, and sip hot cocoa with your family.

Whenever you start feeling worn down from the stress or start feeling bad for yourself, do something productive. You could make yourself a structured job search plan that incorporates, or research companies you're interested in. Or you could do something that's not related to your job search at all.

You can hit the gym, take a walk outside to get some fresh air and sunshine, or you can indulge in a good book for 30 minutes. Don't feel guilty about doing these things—they're necessary for your mental and physical health, which are two things you can't neglect, especially during a job search.

2. Focus On What You're Excited About

via GIPHY

When someone asks you, "How's the job search going?" don't focus on the negative. Remember: you have the power to control the tone of this conversation. If you focus on your lack of success—how many interviews you haven't gotten or how many companies didn't call you back—you're not only going to make the conversation awkward for both of you, but you're going to feel awful about yourself.

Instead, tell them about a few companies and opportunities you're excited about. Focus on your little wins like having a great informational interview with someone from one of your target companies. Convey your enthusiasm for finding a new job opportunity. It'll make you feel uplifted, and it gives you the opportunity to talk about your job search in a positive way.

3. Laugh, Dance, And Be Merry

via GIPHY

What makes you laugh out loud, even when no one is in the room? What songs make you want to get up and dance, even when people are looking? Find those little things that make you happy and pepper them in throughout your day. There's honestly nothing better than a good laugh.

Distract yourself with positivity—and don't feel bad about taking a "Happy Break" every once in a while. It will help keep you in balance during your holiday job search.

Need more help with your job search?

We'd love it if you signed up for Work It Daily's Event Subscription! Get your career questions answered in our next live event!

This article was originally published at an earlier date.

From Your Site Articles

• 6 Ways To Survive The Holidays When You’re Unemployed ›
• 5 Reasons To Continue Your Job Search During The Holidays ... ›
• 5 Tips For Staying Sane During A Holiday Job Search - Work It Daily ... ›
• 3 Things Nobody Tells You About Job Hunting - Work It Daily | Where Careers Go To Grow ›
• How To Stay Positive During a Long Job Search - Work It Daily | Where Careers Go To Grow ›
• 5 Tips For Getting A Job During The Holidays - Work It Daily | Where Careers Go To Grow ›

Related Articles Around the Web

• 5 Reasons To Job Search Over The Holidays ›
• How to use the holidays to boost your job search ›
• Tips for Job Searching During the Holidays | FlexJobs ›

holiday job search {"customDimensions": {"1":"Ariella Coombs, Jenna Arcand","3":"career, career advice, career help, career tips, happiness, happy, holiday, holiday job search, holiday season, holidays, job search, job search advice, job search during holidays, job search during the holidays, job search help, job search tips, job seekers, looking for a job during the holidays, positive attitude, positivity, stay positive during a holiday job search, staying positive, unemployed","2":"popular","4":"12/06/2022"}, "post": {"split_testing": {}, "providerId": 14, "sections": [0, 370480899, 376550212, 404327439, 479660731, 543270555, 473310813, 473333499], "buckets": [], "authors": [19548592, 19836096]} } 8 Ways You're Being SHUT OUT Of The Hiring Process1-hour workshop to help job seekers figure out what's getting them tossed from the hiring processCover Letter 3 Tips For Overcoming Your Biggest Job Search FEARS Jenna ArcandSeptember 28, 2022 {"adCodes": [{"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 0, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}, {"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 1, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}, {"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 2, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}], "adsOrder": [2]} Are you terrified of screwing up a job interview? Does the thought of writing a cover letter horrify you? Are you scared to network with others? What do you even say, anyway? If you're struggling to overcome your job search fears, this live event is for you.

We get it. Looking for work can be scary, especially if you’ve been at it for a long time and haven’t gotten any results.

Understanding which fears are getting in the way and how to overcome them will make all the difference. Sometimes you might not be aware of which obstacle is getting in the way of your goals. If you want to overcome these fears once and for all, we invite you to join us!

In this training, you’ll learn how to:

• Utilize strategies for coping with your job search fears
• Be confident in your job search—from writing your resume to networking
• Face your fears and move forward

Join our CEO, J.T. O'Donnell, and Director of Training Development & Coaching, Christina Burgio, for this live event on Wednesday, October 5th at 12 pm ET.

CAN'T ATTEND LIVE? That's okay. You'll have access to the recording and the workbook after the session!

Read moreShow lessjob search fears {"customDimensions": {"1":"Executive Community, Jenna Arcand","3":"live events, career events, j.t. o'donnell, jt o'donnell, christina burgio, career advice, career, career growth, professionals, job search, job seekers, job interview, job search tips, job search advice, interview, job interview tips, interview tips, job search fears, overcome job search fears, networking, cover letter, resume, writing a cover letter, job search strategy, job search help, looking for a job, unemployed","2":"cover-letter","4":"09/28/2022"}, "post": {"split_testing": {}, "providerId": 0, "sections": [0, 376490081, 562457120, 370480899, 376490053, 376489574, 376491143, 376489962, 404327439, 376489624, 479660731, 543270555, 473310813, 473333499], "buckets": [], "authors": [21030904, 19836096]} } Get Some LeverageSign up for The Work It Daily NewsletterEnter emailSubscribeFollow window.googletag = window.googletag || {cmd: []}; googletag.cmd.push(function() { googletag.defineSlot('/22278042776,22664312254/wit/wit_multiplex', ['fluid'], 'wit_multiplex').addService(googletag.pubads()); googletag.enableServices(); googletag.display('wit_multiplex'); }); Community Why Contact Centers Are A Good Way To Start Your Career Liam AndersonDecember 06, 2022 Bigstock {"adCodes": [{"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 0, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}, {"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 1, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}, {"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 2, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}], "adsOrder": [2]}

“Do you really want to work in a contact center?”

Let’s be honest: five-year-olds don’t dream about working in a contact center when they grow up. Proud parents never boast about their children working in contact centers. Teachers at private schools never recommend students to work in contact centers.

People see contact centers as cubicle farms with hundreds of people on the phones selling non-existent products and services.

I’m going to tell you something different.

Contact centers are a great way for a person to start their career.

The Size Of The Industry

Bigstock

About 2.79 million Americans and U.S. residents, slightly more than 2% of the working population, work in contact centers.

The real figure may be higher. Many companies may call their contact centers “service centers,” “customer service centers," or “help desks.”

A contact center agent’s average tenure is three years. All 2.79 million agents change their jobs every three years. The industry will have 930,000 vacancies every year, which equates to approximately 77,000 vacancies a month.

If you’re leaving university with a student loan to pay off, there’s no shortage of vacancies.

Getting In On The Ground Floor

Bigstock

​It’s tough for newcomers to the workforce. Everyone wants previous experience. Contact centers are less likely to demand that. Joining a contact center attached to a specific industry can get you a grounding in that industry.

The companies serving consumers run contact centers. They include banks, debt collection agencies, the government (both local and national), insurance, healthcare, information technology, telecommunications, travel and tourism, and utilities. If you want to get experience in one of these industries, there’s a contact center for you to get your foot in the door.

As well as industry experience, you will also develop your people skills. That’s more than you’ll get from an MBA course. As a contact center agent, you’ll deal with up to 100 people per day. You’ll learn how to build rapport with complete strangers, explain things to emotional people, and stay calm under pressure or in the face of insults. Some people call these “soft skills.” These “soft skills” make people want to do business with you, hire you, or maybe even marry you!

Contact centers are a tech-heavy environment. You will learn to work with various programs and applications from day one. This will improve your technical skills and, more importantly, develop your ability to learn how to use technology. Technology changes all the time, but it will always be with us.

Contact centers give you the opportunity to work on yourself. Contact center work can be monotonous and repetitive. So is unemployment. This is your opportunity to develop your resilience and determination. Most contact centers provide you with regular coaching to improve your performance. Responding positively to coaching is a key element of being employable in today’s workforce. Contact center agents learn how to work in teams where success is not one person getting good exam results, but a customer having their requests fulfilled as quickly and effectively as possible.

You can learn all this in your first job!

Going Up!

Bigstock

What can contact centers offer people who stay longer than three years?

In the U.S., the average contact center employs 54 agents. That means one manager for every 54 agents, and on average, there is one supervisor for every 8.6 agents.

The contact centers industry is unusually “democratic.” Over the past 12 years, I have worked with more than 200 contact centers on three continents. In most cases, the managers started their careers as agents.

The industry also needs data analysts, IT specialists, developers, trainers, and coaches. Many of them started their careers as agents.

A Growth Industry

Bigstock

​Two factors have had a major impact:

The pandemic forced many companies to abandon face-to-face operations, relying on their contact centers to communicate with customers. Customers got used to doing business online. Now, many customers don’t want to go back to physically visiting a branch. Companies also welcome the change. Offices and shops are expensive to run in relation to the number of customers they serve. Companies are looking to expand their contact center operations as part of their strategy to go digital.

Legislation in many Western countries makes changing bank accounts, insurance, telecommunications, or utilities providers easier. Customer service is now the competitive battleground of the 21st century. Contact centers are expected to hold that ground and win.

A Changing World

Bigstock

The shift to cloud technology is revolutionizing the industry, making access to transformational technologies less expensive and more available.

Companies are increasingly turning to artificial intelligence (AI) powered chatbots to handle simple interactions. This increases capacity without increasing headcount and frees up humans to handle more challenging interactions.

As automated systems handle simple tasks, human agents will handle more complex requests or help out customers who having trouble dealing with the bots. Human agents will need to be better trained both in terms of product and service knowledge and also in terms of emotional intelligence and communication skills.

Supervisors are likely to become more human-centered as automation will handle the numerical tasks. Supervisors will concentrate on coaching and motivating human agents or assisting in solving the most complicated customer issues and requests.

The wrap-up

The contact center industry has much to offer anyone looking for a job, regardless of experience. If you’d like to talk to an industry veteran, please reach out to me on LinkedIn.

Further reading...

Here are some more articles about the contact center industry:

Creating Quality Standards For Contact Centers

Using Quality Management To Improve KPIs

How To Reduce Average Handling Time (AHT) In Contact Centers

Read moreShow lesscall center {"customDimensions": {"1":"Executive Community, Liam Anderson","3":"call center, call centers, contact center, contact centers, starting your career, starting career, starting at a contact center, starting at a call center, customer service, help desk, customer service rep, customer service representative, working at a call center, working at a contact center, recent college graduates, recent college grads, first job, first job out of college, sales","2":"community","4":"12/06/2022"}, "post": {"split_testing": {}, "providerId": 0, "sections": [0, 544324100, 544398580, 544398581, 479660731, 544398590, 473333499], "buckets": [], "authors": [21030904, 25006587]} } Community The Data Science ROI Of Moving To The Data Lakehouse Anthony BrandaDecember 06, 2022 iStock {"adCodes": [{"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 0, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}, {"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 1, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}, {"desktop": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "display": true, "mobile": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e", "new_amp": "\u003camp-ad width=336 height=280\n type=\"doubleclick\"\n data-slot=\"/22278042776,22664312254/wit/wit_content\"\n data-multi-size=\"300x250\"\u003e\n\u003c/amp-ad\u003e", "order": 2, "tablet": "\u003cdiv class=\u0027rblad-wit_content\u0027\u003e\u003c/div\u003e"}], "adsOrder": [2]}

Many CDOs/CDAOs (and even CMOs) have raised some interesting questions about these three data management and data science titans: Snowflake, Databricks, and DataRobot. Some of the questions include:

• Can Snowflake replace the CDP?
• Do I need Databricks if I have ML Ops capabilities or other capabilities that are similar?
• What is the difference between DataRobot and Databricks?
• How do we prevent the siloing of marketing data and smooth access by other domains?

Later in this post, I’ll be discussing these questions with Ed Lucio, a New Zealand data science expert for Spark (telecom provider) and former lead data scientist for ASB Bank. We’ll be giving our POV on these questions as well as highlighting a few data analytics use cases that can be driven by these tools once they are in place. I would love to hear from you regarding other use cases and your experiences with data lakehouses.

Before diving into my conversation with Ed, a quick overview of environments and tools...

Types Of Storage Environments

Bigstock

We, as an industry, have gone from the data warehouse to data lakes, and now to data lakehouses. Here’s a brief summary of each.

The data warehouse: Closed format, good for reporting. Very rigid data models that require moving data, and ETL processes. Most cannot handle unstructured data. Most of these are on-prem and expensive and resource-intensive to run.

The data lake:

Pros

• Handles ALL data, supporting data science and machine learning needs. Can handle data with structure variability.

Cons

• Handles ALL data, supporting data science and machine learning needs
• Difficult to:
  • Append data
  • Modify existing data
  • Stream data
• Costly to keep history
• Metadata too large
• File-oriented architecture impacting performance
• Poor data quality
• Data duplication - hard to implement BI tasks, leading to two data copies: one in the lake, and another in a warehouse, often creating sync issues.
• Requires heavy data ops infrastructure

Data lakehouse: Merges the benefits of its predecessors. It has a transactional layer on top of the data lake that allows you to do both BI and data science in one platform. The data lakehouse cleans up all of the issues of the data lake, supporting structured, unstructured, semi-structured, and streaming data.

Current Data Environments and Tools

The following tools summary is from my deploying the tools as a CDO/CDAO and executive general manager, not as an architecture or engineer. This is a synopsis of the top-line features of each but if you want to add to your experience with the features please reply to the post and add to the synopsis.

What is Snowflake?

Snowflake is a highly flexible cloud-based big data warehouse that has some unique and specialized data security capabilities allowing businesses to transition their data to the cloud as well as to partner and share data. Snowflake has made much progress in building partnerships and APIs and integrations. One interesting possibility that marketers may want to consider is that snowflake can be leveraged as the CDP directly and activate campaign data through a number of their partners. See their website for more details.

Snowflake is a data lakehouse that like its competitors is indifferent to structure variability and can support structured, semi-structured, and unstructured data. Its uniqueness for me is a few folds:

• Ability to create highly secure data zones (a key strength) - You can set security at the field and user level. Strong partners like Alation and High Touch (a reverse ETL tool or ELT).
• Ability to migrate structured and SQL-based databases to the cloud.
• Ability to build unstructured data in the cloud for new data science applications.
• Ability to use Snowflake in a variety of contexts as a CDP or a marketing subject area. If Snowflake becomes your CDP, you save the expense and other issues of having multiple marketing subject areas.

Many organizations today are using data clouds to create a single source of truth. Snowflake can ingest data from any source, or format, using any method (batched, streaming, etc.), from anywhere. In addition, Snowflake can provide data in real time. Overall, it is good practice to have the marketing and analytics environments reside in one place such as Snowflake. Many times, as you generate insights you want to operationalize those insights into campaigns hence having them in one CDP environment improves efficiency. High-touch marketers, supported by their data analytics colleagues and Snowflake, can activate their data and conduct segmentation and analysis all in one place. Snowflake data clouds enable many other use cases:

• One version of the truth.
• Identity resolution can live in the Snowflake data cloud. Native integrations include Acxiom, LiveRamp, Experian, and Neustar.
• You don’t have to move your data, so you increase consumer privacy with Snowflake. There are advanced security and PII protection features.
• Clean room concept: No need to match PII to other data providers and move data. Snowflake has a media data cloud, so working with media publishers who are on Snowflake (such as Disney ad sales and other advertising platforms) simplifies targeting. As a marketer, you can work with publishers who built their business models on Snowflake without exposing PII, etc. Given the transformation that is happening due to the death of the third-party cookie, this functionality/capability could be quite impactful.

What is Databricks?

Databricks is a large company that was founded by some of the original creators of Apache Spark. A key strength of Databricks is that it’s an open unified lakehouse platform with tooling that helps clients collaborate, store, clean, and monetize data. Data science teams report the collaboration features were incredible. See the interview below with Ed Lucio.

It supports data science and ML, BI, real-time, and streaming activities:

• It’s software as a service with cloud-based data engineering at its core.
• The lakehouse paradigm allows for every type of data.
• No or low-performance issues.
• Databricks uses a Delta Lake storage layer to improve data reliability, using ACID transactions, scalable metadata, and table-level and row-level access control (RLAC).
• Able to specify the data schema
• Delta Lake allows you to do SQL Analytics, an easy-to-use interface for analysts.
• Can easily connect to PowerBI or Tableau.
• Supports workflow collaboration via Microsoft Teams connectivity.
• Azure Databricks is another version for the Azure Cloud.
• Databricks allows access to open-source tools, such as ML Flow, TensorFlow, and more.

Based on managing data scientists and large analytics teams, I would say that Databricks is preferred over other tools due to its interface and collaboration capabilities. But as always it depends on your business objectives in terms of which tool you select.

What is DataRobot?

DataRobot is a data science tool that can also be considered an autoML approach: it automates data science activities and thus furthers the democratization of machine learning and AI. The automation of the modeling process is excellent. This tool is different from Databricks which deals with data collection and other tasks. It helps fill the gap in skill sets given the shortage of data scientists. DataRobot:

• Builds machine learning models rapidly.
• Has very robust ML Ops to deploy models quickly into production. ML Ops brings the monitoring of models into one central dashboard.
• Creates a repository of models and methods.
• Allows you to compare models by methods and assess the performance of models.
• Easily exports scoring code to connect the model to the data via an API.
• Offers a historical view of model performance, including how the model was trained. (Models can easily be retrained.)
• Includes a machine learning resource to manage model compliance.
• Has automated feature engineering; it stores the data and the catalog.

Using Databricks and DataRobot together helps with both data engineering AND data science.

Now that we have a level set on the tools and vendors in the space, let’s turn to our interview with Ed Lucio.

Interview With Ed Lucio

Bigstock

Tony Branda:

Many firms struggle to deploy machine learning and data operations tools in the cloud and to get the data needed for data science into the cloud. Why is that? How have you seen firms resolve these challenges?

Ed if you could unpack this one in detail? Thanks, Tony.

Ed Lucio:

From my experience, the challenge to migrate data infrastructures and deploy cloud-based advanced analytics models is a more common issue in traditional/larger organizations which have at least one of the following: built significant processes on top of legacy systems, is in vendor/tooling lock-in, in a ‘comfortable’ position where cloud-based advanced analytics adoption is not the immediate need, and the information security team is not yet well adept on how this modern technology is aligned to their data security requirements.

However, in progressive and/or smaller organizations where there is an alignment from senior leaders down to the front line (coupled with the immediate need to innovate), cloud-based migration for infrastructures and deployment of models is almost natural. It is scalable, more cost-effective, and flexible enough to adjust to dynamic business environments.

I have seen some large organizations resolve these obstacles through strong senior leadership support where the organization starts building cloud-based models and deploys smaller use cases with less critical components for the business. The objective is just to prove the value of the cloud first, then once a pattern has been established, the company can scale up to accommodate bigger processes.

Tony Branda:

Why is Databricks so popular as one tool category (Data Ops/ML Ops), and what does their lakehouse concept give us that we could not get from Azure, AWS, or other tools?

How does Databricks help data scientists?

Ed Lucio:

What I personally like about Databricks is the unified environment that helps promote collaboration across teams and reduces overhead when navigating through the “data discovery to production” phases of an advanced analytics solution. Whether you belong to the Data Science, Data Engineering, or Insights Analytics team, the tool provides a familiar interface where teams can collaborate and solve business problems together. Databricks provide a smooth flow from managing data assets, performing data exploration, dashboarding, and visualization, to machine model prototyping and experiment logging, and code and model version control. When the models are deemed to be ready by the team, deploying these through a job scheduler and/or an API endpoint is just a couple of clicks away and flexible enough for the business needs whether it is needed for either batch or real-time scoring. Lastly, it is built on open-source technology which means that when you need help, the internet community would almost always have an answer (if not, your teammates or the Databricks Solutions Architect would be there to assist). Other sets of cloud tools would be able to provide similar functionalities, but I haven’t seen one as seamless as Databricks.

Tony Branda:

On Snowflake, AutoML tools, and others, how do you view these tools, and what is your view on best practices?

Ed Lucio:

Advanced analytics discovery is a journey where you have a business problem, a set of data and hypotheses, and a toolkit of mathematical algorithms to play with. For me, there is no “unicorn” tool (yet) in the market able to serve all the data science use-case needs for the business. Each tool has its own strengths, and it would need some tinkering on how every component would fit the puzzle in achieving the end business objective. For instance, Snowflake has nice features for managing the data asset in an organization, while the AutoML tooling (DataRobot/H2O) is good for automated machine learning model building and deployment.

However, even before proceeding to create an ML model, an analyst would need to explore the dataset for quality checks, understand relationships, and test basic statistical hypotheses. The data science process is iterative, and organizations would need the tools to be linked together so that interim outputs are communicated to the stakeholders to pivot or confirm the initial hypothesis, and to share the outputs with the wider business to create value. Outputs from each step would typically need to be stitched together to get the most from the data. For example, a data asset could be fed into a machine learning model where the output would be used in a dashboarding tool for reporting. Then, the same ML model output could be further enhanced by business rules and another ML model to be fit for purpose on certain use cases.

On top of these, there must be a proper change control environment governing the code and model versioning and transitioning of codes/models from development, pre-prod, and prod environments. After deploying the ML model, it needs to be monitored to ensure that model performance is within a tolerable range, and the underlying data has not drifted from the training set.

Tony Branda:

Are there any tips and tricks you’d recommend to leaders in data analytics (DA) or data science (DS) to help us evaluate these tools?

Ed Lucio:

Be objective when evaluating the data science tooling and work with the data science and engineering teams to gather requirements. Design the business architecture which supports the organization’s goals, then work backward together with the enterprise architect and platform team to see which tools would enable these objectives. If the information security team objects to any of the candidate toolings, have a solution-oriented mindset to find alternative configurations to make things work.

Lastly, strong support from the senior leadership team and business stakeholders is essential. Having a strong focus on the potential business value, the need to enable the data science tools would always come in handy.

Tony Branda:

What is the difference between a data engineer and a data scientist, and an ML engineer (in some circles referred to as a data science data engineer)? Is it where they report or do they have substantial skill differences? Should they be on the same team? How do we define roles more clearly?

Ed Lucio:

I see the data engineers, ML engineers, and data scientists being part of a wider team working together to achieve a similar set of objectives: to solve business problems and deliver value using data. Without going into too much detail:

• Data engineers build reliable data pipelines to be used by insight analysts and data scientists.
• Data scientists experiment (i.e., apply the scientific process) and explore the data on hand to build models addressing business problems.
• ML model engineers work collaboratively with the data scientists and data engineers to ensure that the developed model is consumable by the business within the acceptable range of standards (i.e., batch scoring vs real-time? Will the output be surfaced in a mobile app? What is the acceptable latency?).

Each of these groups would have their own sets of specialized skills, but at the same time, should have a common level of understanding of how each of their roles work side-by-side.

Many thanks to Ed Lucio, Senior Data Scientist at Spark in New Zealand, for his contributions to this article.

In summary, this article has provided a primer on data lakehouses and three of what I consider to be the leading-edge tools in the cloud data lakehouse and machine learning space. I hope Ed Lucio’s POV on the tools and their importance to data science was helpful to those considering their use. At the end of the day, all of this—selection of environments and tools—depends on the business needs and goals: what are the problems that need solving, as well as the level of automation the business is driving towards.

As always, I’d love to hear about your experiences. What has your experience been with data lakehouses, ML Ops, and data science tooling? I look forward to hearing from you regarding this post.

Read moreShow lessdata lakehouse {"customDimensions": {"1":"Executive Community, Anthony Branda","3":"data lakehouse, data science, cdao, cao, data warehouses, cloud, data lake, machine learning, artificial intelligence, snowflake, databricks, datarobot, ed lucio, data, data analytics","2":"community","4":"12/06/2022"}, "post": {"split_testing": {}, "providerId": 0, "sections": [0, 544324100, 544398568, 544398580, 544398581, 473333499, 479660731], "buckets": [], "authors": [21030904, 25270454]} } Featured Why Contact Centers Are A Good Way To Start Your Career {"customDimensions": {"1":"Executive Community, Liam Anderson","3":"call center, call centers, contact center, contact centers, starting your career, starting career, starting at a contact center, starting at a call center, customer service, help desk, customer service rep, customer service representative, working at a call center, working at a contact center, recent college graduates, recent college grads, first job, first job out of college, sales","2":"community","4":"12/06/2022"}, "post": {"split_testing": {}, "providerId": 0, "sections": [0, 544324100, 544398580, 544398581, 479660731, 544398590, 473333499], "buckets": [], "authors": [21030904, 25006587]} } Now Hiring: Remote SysOps Engineer {"customDimensions": {"1":"Work It Daily, Kinsta \u00ae","3":"kinsta, hiring, remote jobs, remote work, remote workforce, remote companies hiring, remote companies 2021, sysops engineer, sysops engineer jobs","2":"popular","4":"05/18/2021"}, "post": {"split_testing": {}, "providerId": 0, "sections": [370480899, 545998439, 545998440, 473310812, 376489962, 526353713, 545658354, 548352055, 548352058, 543270555, 473333499, 473310813], "buckets": [], "authors": [19548593, 21891195]} } 3 Important Career Lessons Learned On And Off The Field {"customDimensions": {"1":"Executive Community, J.T. O'Donnell","3":"career change, entrepreneur, entrepreneurship, career, career challenges, overcoming career challenges, personal branding, personal development, professional development, professional growth, success, career success, pro athletes, tom brady, chris gronkowski, nfl, tiktok, social media strategy, social media, career growth","2":"popular","4":"02/10/2021"}, "post": {"split_testing": {}, "providerId": 0, "sections": [0, 370480899, 473333499, 376489962, 526353713, 376489624, 479660731], "buckets": [], "authors": [21030904, 19549412]} } How Ex-NFL Player, Chris Gronkowski, Is Using Social Media To Change Careers {"customDimensions": {"1":"Executive Community, J.T. O'Donnell","3":"2010, Barstool, camera phone, career growth and development, career growth opportunities, chrisgronkowski, cowboys, dallascowboys, dinner, football, free, gronkspike, iceshaker, investor, nfl, nflfootball, nflplayer, nflplayers, nflworkout, payday, rookie, salary, sharing, sharktank, tic toc, tic tok, tick tock, ticktock, tictok, tik tok, tiktok, tiktok.com, trade, trainingcamp, upload, video, video phone, weighin, youtube.com, \u0442\u0438\u043a \u0442\u043e\u043a, \u30c6\u30a3\u30c3\u30af\u30c8\u30c3\u30af, chris gronkowski","2":"popular","4":"01/29/2021"}, "post": {"split_testing": {}, "providerId": 0, "sections": [0, 370480899, 473333499, 526353713, 376489624, 479660731], "buckets": [], "authors": [21030904, 19549412]} }