Categories
Data Analytics

Retail Analytics: Boost Your Business in One Day

Few industries are as well-positioned as retail to use data-driven systems to improve their bottom lines. Retail analysis is flush with sources of data, including information that can be derived from sales, inventory, traffic and marketing. Turning all this information into something useful, however, requires an understanding of where retail data systems fit into the bigger picture. Let’s take a look at the trend and how data analytics software may be used to boost your business.

How is it Affecting the Retail Industry?

As of 2019, omnichannel marketing and sales have become key features of how many retailers and customers interact. Even the simplest forms of this approach have changed what items are put into inventory, which customers are met with what appeals, how prices are chosen and how stores themselves are designed.

For example, let’s look at loss prevention systems that are used by many brick-and-mortar retailers. Using retail analysis methods, we can quickly spot which departments suffer the greatest losses. Items that are commonly stolen can be moved to spots where sales associates can see them. Closed areas of stores that allow for bad behavior can be opened up to observation. Patterns that might not be obvious to the average person can be discovered by comparing data across multiple stores.

Why Should Retailers Invest in Data Analysis?

Supply chains are being tightened up like never before. In the world of clothing sales, for example, you want to keep inventory purchases as close to trend spotting as possible. Retail data systems can dig deep into information gleaned from social media to empower buyers on the other side of the planet to make decisions about items to put in stores and on websites. The timing of trend data pulled from customer analysis will increase the chances that a trend will arrive in stores right before it’s ready to take off with the general public.

Personalization also offers many opportunities. Insights can be derived from mobile apps, website purchases, in-store sensors and post-of-sale units. Marketing appeals can then be tailored to the specific tastes and desires of the customer, such as offering coupon codes via text when the mobile app notices they’re within a certain driving range of a physical store.

All of this is data intensive. Customer analytics calls for a backend of systems that can store data securely and make it readily available to decision-makers in a timely manner.

Analyzing Customer Behavior

Good data science people approach customer analysis with a highly experimental attitude. Let’s say you want to determine the optimal layout for your store’s website. A/B testing methods can be utilized to discover how to maximize ROI. You simply serve multiple version of the website, and then you can use data analytics software to compare which versions kept folks on the site longest, drove sales and encouraged return engagement. Customer analytics can even be utilized to establish whether some customers should be pursued more aggressively with offers, sales and other incentives.

Using Predictive Analytics

Figuring out where to put money before the next sales season hits will be one of the biggest goals of many retail analysis efforts in 2019. In-store Wi-Fi offered for free can include opt-ins that allow data gathering and mining to be performed. These can then be used to determine which customers should be encouraged with loyalty programs, points offers and more. Metadata can even be employed to establish what the relationships are among different customers, allowing you to see how friends circles and families influence members.

Ultimately, you want to get to the point that predictive systems provide prescriptions. In addition to getting ahead of trends, decisions can be made about how many items to put on shelves, what times of day customer support is most needed and where to place salespeople in stores.

Processes will be increasingly tailored around the customer experience and ROI. Assortment analytics can be used to make recommendations regarding products that are frequently purchased together. This can be used, for example, to issue coupons at checkout that will encourage customers to come back soon. Similarly, website and app versions of stores can point customers toward product recommendations they’ll actually want.

Deriving these sorts of insights is not a light undertaking. Data needs to be accumulated in sufficient quantities to ensure that predictions actually track closely with results. A data-driven attitude has to be fostered throughout a business, and an eye always has to be kept on quality control. In time, though, a company can form a robust base to work from and to deliver value to both customers and internal stakeholders.

Categories
Data Analytics Data Quality Data Science Careers

I’m Outta Here: The Top Frustrations of a BI Engineer

The statements below first appeared in the r/BusinessIntelligence subreddit.

I have been working as a BI Developer/Consultant for the past 5 years after graduating from University. Many people are thinking about a career in this field. I thought I would offer my perspective of the problems I have faced and what led to my decision to move away from BI. Would love to hear any opinions/advice from others.

The first point I want to raise is that things have changed A LOT in BI/Data jobs over the past 5 years and not for the better. The job does not carry the same level of respect or ‘perceived’ value in an organization. Before you all murder me, let me explain. Data has more value than ever, I agree. However, the people who extract, clean, combine and deliver this data have much lower value. I am not sure why this has developed.


Advantages of BI/Data Careers

Job title of BI sounds fancy to most people. Salary ramp-up to mid level ($80k) on par or better than other IT/Business fields. (BI does cap out much earlier than other fields).

Easy to get into a low workload job as a Excel/PowerBI/Tableau data cruncher with a mid-level salary. Progress after that is very hard unless you make shifts to other areas.

Disadvantages of BI/Data Careers

Work that nobody wants to do gets dumped into the BI department. Its role is less well defined and it’s easy to sneak the mistakes of others into “the data department.” There’s no systematic way of managing the quality of what arrives in. Once we’ve taken custody of it and a few days have passed, it’s our problem. As if somehow 7,000 emails got turned into NULL in the 2 days since you sent me your file.

I once worked with a client that ran a yearly survey to gather data. They produced a report of top 100 companies and industry trends. Nobody in the client’s company wanted to sift through over 10,000 survey responses. Nobody wanted to clean data, extract insights from survey responses. So they just sent it.

This entire workload fell to us. the external consulting company, even with our $150-per-hour bill rate. It took us weeks of work and the company paid out quite a bit. Of course, remember I did not see $150-per-hour for this work, I just received my salary, which was in the $60k range. So who benefited and who overpaid?

Another example, this time from a large enterprise. Daily data loads extract data from [HR, finance, payroll, etc.] systems. New employees are sometimes set up with different/wrong values in different systems. This causes major issues in reporting/BI tools. Senior Management was quick to blame BI. They didn’t consider the inefficient processes, or mistakes at the operational level that led to this. The HR/Finance analysts don’t care about these issues. It got so bad, eventually setting up new employees in the HR system fell to BI analysts. They main reason was that they cared the most about the data.

The end users look at the data once a month if at all. The weekly emailed static reports often go unread. Instead the end users revert back to the prior solution where data is sourced by BI analysts manually. Guess what the reason was? End users find it boring to have to use cubes to browse data or PowerBI/Tableau to manipulate data. They prefer to file a request with the BI team and let them do that work, or have analysts send them a weekly email. Or simply sit in a meeting where someone else tells them what’s going on.

Salary cap to what BI developers can earn. I find that as a BI developer, my salary peaks at around 80% of what other types of developers earn at upper levels. Market rate for me is 90-100K (USD) in house and 100-120K (USD) consulting.

This is made worse by the number of senior SQL server/DBA/BI consultants (+20 experience) in the market. You don’t need more than 3/4 years experience with a BI toolset to get the job done properly. Yet I have been on many projects where clients have asked for someone with 12+ years experience. They’re later surprised when they learn someone with 4 years experience did the projects.

Job tied to a tool/industry. I was never sure why this matters so much. The ability to learn a new tool to get the job done is under-appreciated. I have worked in finance/retail/media and government BI. But I have been told I am not skilled enough to work in x industry or with y tool that varies slightly. Add to this jobs where I see people with masters or PhD level education doing BI Analyst work. People are on-average under-utilized, in my opinion.

BI testing. The most boring, manual, but most necessary part of any BI project.

Testing SQL business logic is painful because of the lack of automated testing solutions used across companies .

Testing with popular tools (PowerBI, Tableau) is nearly always manual . (Good luck testing complex finance dashboards with complex DAX business logic.)

Source system testing is non-existent. (What happens if you change the time zone in a source finance application. Does all the data for the user we extract change at a DB level as well?)

ETL testing (good luck testing 100+ SSIS packages).

Data Warehouse testing: all too often, complex business logic is piled on top of existing logic due to source system upgrades. cube/dashboard testing. No automated solutions exist. Mainly manual.

It’s rare to find business users who will agree to do testing properly. I have seen business users resign from jobs rather than sit and test large amounts of data manually.

While a career in BI is still very attractive to knowledge workers, I wanted to share the pitfalls. I hope my experience helps others. The space still has some maturing to do. If you get with the right organization, it can still be a great career. If they let you use the right data analysis tools, it can still be a win. The key is being able to quickly understand the environment and make quick decisions.

As an employee, you should be watchful for this, but you do have some choices . As a consultant – as I was/am – you’ll often get dragged into some of the worst environments to help fix things.

Expect that.

One can easily find themselves stuck cleaning data in Google Sheets for most of each day. It’s important to recognize the signs and signals of a good BI vs. a bad BI environment. My advice: look for places where business users are actively involved in BI projects. Companies that invest in their data, and in advanced AI tools. Places where they actually care about the outcome and respect the work you do. Because it’s important. You’re important.

Good luck out there.

The statements above first appeared in the r/BusinessIntelligence subreddit.

 

Polk County Schools Case Study in Data Analytics

We’ll send it to your inbox immediately!

Polk County Case Study for Data Analytics Inzata Platform in School Districts

Get Your Guide

We’ll send it to your inbox immediately!

Guide to Cleaning Data with Excel & Google Sheets Book Cover by Inzata COO Christopher Rafter