Fast-moving consumer goods is an industry of thin margins and enormous volumes, where a one percent improvement in forecast accuracy is worth more than most software projects ever deliver. It is also an industry where the manufacturer usually does not own the customer relationship — the retailer does — which means the most valuable data sits with someone else. Both facts shape what artificial intelligence can realistically achieve here.
This guide covers where AI genuinely changes consumer goods operations: demand forecasting, promotion planning, shelf intelligence, direct-to-consumer channels and supply chain resilience. It explains how each works, what data it requires, and why the data problem is almost always harder than the modelling problem.
What you will learn
- Why FMCG is structurally different from other retail technology
- How demand forecasting works, and why the last mile is the hard part
- Trade promotion optimisation, the largest under-managed spend in the industry
- Shelf and image intelligence in physical stores
- What direct-to-consumer channels change, and what they do not
- The data foundations every application above depends on
- What makes FMCG structurally different
- Demand forecasting
- Trade promotion optimisation
- Assortment and range decisions
- Shelf intelligence and image recognition
- Supply chain and production planning
- Direct-to-consumer channels
- Revenue growth management and pricing
- Marketing and product development
- The data foundations
- Building the web platform underneath
- Measuring value honestly
- Twelve failure patterns
- A worked example: one category, one year
- Frequently asked questions
1. What makes FMCG structurally different
Several characteristics distinguish consumer goods from other sectors, and they determine which applications are worth pursuing.
- You sell to retailers, not consumers. A manufacturer's direct customer is a supermarket chain. Consumer-level data must be bought, inferred or obtained through partnership, and it arrives late and incomplete.
- Volumes are enormous and margins are thin. Small percentage improvements produce large absolute results, which makes marginal optimisation genuinely worthwhile in a way it is not elsewhere.
- Products are perishable or seasonal. Forecast too high and you write off stock; too low and you lose sales that go permanently to a competitor's product on the shelf.
- Promotions dominate demand. A significant share of volume moves on promotion, and promotional periods behave nothing like baseline periods. Forecasting without modelling promotions is forecasting the wrong series.
- The physical shelf is the point of decision. Most purchases are made in seconds in front of a shelf, which makes availability and visibility more important than almost any digital intervention.
- Long production lead times. Decisions are committed weeks or months before demand materialises, which is precisely why forecasting matters so much.
The single most valuable question in FMCG analytics is not "what will sell" but "what did we fail to sell because it was not on the shelf". Lost sales leave no trace in your sales data, which means the most expensive failures are the ones your reporting cannot see.
2. Demand forecasting
The foundational application, and the one everything else depends on. A demand forecast predicts how much of each product will be needed, at what location, in what period.
What the model actually uses
Historical shipments are the starting point and the weakest signal, because they reflect what retailers ordered rather than what consumers bought. Where available, point-of-sale data from retailers is dramatically better — it describes actual consumption rather than inventory movement between warehouses.
Beyond history, the features that matter are: promotional calendar and mechanics, price and competitor price, seasonality at several scales, weather for weather-sensitive categories, holidays and local events, distribution changes such as a new listing or a delisting, and cannibalisation from related products.
Why the last mile is hard
Forecasting total national volume for a well-established product is comparatively easy, and comparatively useless. What operations need is a forecast per product per distribution centre per week, and at that granularity the series becomes sparse, noisy and dominated by one-off events. Accuracy at aggregate level routinely looks excellent while the granular forecasts that actually drive production are poor.
The practical response is hierarchical forecasting: model at the level where the signal is strongest, then reconcile up and down the hierarchy so that granular forecasts sum correctly to the aggregate. This is both more accurate and more explainable than forecasting every combination independently.
Measuring it properly
Forecast accuracy should be measured at the level decisions are made, over the horizon decisions require, and with a baseline for comparison. A model that beats last year's actuals by a small margin may be worse than a simple seasonal average, and nobody knows without measuring both. Track bias separately from error: a forecast that is consistently ten percent high is a different and more fixable problem than one that is wildly variable.
3. Trade promotion optimisation
Trade promotion — the money paid to retailers for price reductions, displays and features — is typically among the largest lines on a consumer goods income statement, and it is frequently the least measured. Estimates of the share of promotions that fail to break even are consistently uncomfortable across the industry.
The analytical problem is genuinely hard for reasons worth understanding:
- Uplift must be separated from baseline. Sales rose during the promotion, but some of that would have happened anyway. Estimating the counterfactual is the whole exercise.
- Forward buying distorts everything. Retailers purchase extra stock at the promotional price and sell it afterwards at full margin, which inflates promotional volume and depresses the following period.
- Cannibalisation is real. Promoting one variant frequently steals volume from another in the same range, which a product-level analysis will miss entirely.
- Pantry loading delays the effect. Consumers who stock up buy less for weeks afterwards, so a promotion that looks successful in its week may be value-destroying over a quarter.
A model that estimates baseline, uplift, cannibalisation and post-promotion dip together produces a genuine profitability figure per promotion. That figure changes negotiations with retailers, because it converts a discussion about volume into a discussion about incremental profit. This is one of the highest-return analytics applications in the entire sector and one of the most commonly under-resourced.
4. Assortment and range decisions
Which products should be listed in which stores. The naive approach ranks by sales and removes the tail, which reliably destroys value because it ignores three things.
Incrementality. A slow-selling variant may be the only reason a particular shopper visits the category. Removing it loses their entire basket, not just that line.
Substitutability. If a delisted product's buyers switch to another of yours, the delisting is fine. If they switch to a competitor or leave the category, it is expensive. Modelling substitution patterns from transaction data is what distinguishes a good range decision from a spreadsheet exercise.
Local variation. Store-level demand differs enormously by demographics, competition and location type. A national range applied uniformly leaves value on the table in both directions — carrying products that do not sell locally and missing ones that would.
Store-level assortment optimisation is well established in grocery retail and increasingly available to manufacturers through retailer partnerships. Its value is highest in categories with many variants and meaningful regional differences.
5. Shelf intelligence and image recognition
The most visibly "AI-shaped" application in the sector, and one where the technology is genuinely mature.
Field representatives photograph shelves; a vision model identifies products, measures share of shelf, detects out-of-stocks, checks planogram compliance, verifies promotional displays are actually in place, and reads price labels. What previously took a representative twenty minutes of manual counting takes a photograph and a few seconds.
The value is in three places. Out-of-stock detection addresses the invisible losses mentioned earlier — a product missing from the shelf generates no sales data and no complaint, and the shopper simply buys something else. Compliance verification matters because trade spend frequently pays for display placements that are not always executed, and evidence changes that conversation. And share of shelf against competitors provides a competitive picture that sales data alone cannot give.
The practical challenges are unglamorous: product images change with packaging refreshes, requiring continuous model updates; lighting and angles in real stores are poor; and adoption depends on field teams actually taking photographs consistently, which is a change management problem rather than a technical one.
6. Supply chain and production planning
Forecasts are only useful if they drive decisions, and in consumer goods those decisions are production scheduling, inventory positioning and replenishment.
| Decision | What models contribute |
|---|---|
| Production scheduling | Sequencing runs to minimise changeover while meeting demand and shelf-life constraints |
| Inventory positioning | Safety stock calculated from forecast uncertainty per product rather than a blanket rule |
| Replenishment | Predicting when a distribution centre will need stock, ahead of the order arriving |
| Waste reduction | Identifying products at risk of expiry early enough to redirect or discount them |
| Transport | Load consolidation and routing against delivery windows |
| Supplier risk | Early signals of ingredient or packaging supply disruption |
The most under-used idea here is probabilistic forecasting. A single expected number tells a planner nothing about risk. A forecast that expresses a distribution — a most likely value and a range — lets safety stock be set per product according to its actual uncertainty, rather than by a blanket policy that over-stocks predictable products and under-stocks volatile ones. This typically reduces both inventory and stockouts simultaneously, which is unusual enough to be worth pursuing.
7. Direct-to-consumer channels
Many manufacturers have launched direct channels, and the results have been mixed for reasons that are structural rather than technical.
What direct-to-consumer genuinely provides: consumer data you otherwise cannot obtain, including who buys, how often, in what combinations and in response to what. That data improves everything upstream. It also enables product testing at small scale before committing to a retail listing, and it provides a channel for products that do not justify shelf space.
What it rarely provides: meaningful volume. Consumer goods economics are built on scale, and a direct channel selling a small fraction of retail volume will not change the business. Manufacturers who justified direct channels on revenue have generally been disappointed; those who justified them on data and product testing have generally been satisfied.
The operational reality is also worth stating plainly: shipping individual units of low-value goods to consumers has fundamentally different economics from shipping pallets to distribution centres, and manufacturers frequently discover that the fulfilment cost per order exceeds the product margin. Subscription models, bundles and higher-value assortments are the usual responses.
8. Revenue growth management and pricing
Pricing in consumer goods is constrained — the retailer sets the shelf price — but manufacturers control list price, promotional depth, pack architecture and trade terms, and models help with all four.
Price elasticity estimation per product and channel tells you how volume responds to price. This is harder than it sounds because prices rarely change independently of promotions, competitor actions and seasonality, so naive estimation confuses correlation with response.
Pack price architecture is where much of the value sits. Which pack sizes exist, at what price points, and how they relate determines both category value and how much of a shopper's spend you capture. Analysis of substitution between pack sizes frequently reveals that an intermediate size is either missing or cannibalising rather than growing.
Price pack adjustments in inflationary periods — changing size rather than price — require careful modelling of consumer response, and the reputational risk is real if handled clumsily.
9. Marketing and product development
Two areas where language and image models have changed what is practical.
Consumer listening at scale. Reviews, social posts, support contacts and survey free-text contain detailed information about what people like and dislike, in their own words. Classifying and summarising that at scale surfaces themes — a packaging complaint, a flavour preference, a usage occasion nobody anticipated — that would otherwise require expensive manual research. The main caution is that online voices are not representative of buyers generally, and treating them as such produces confident errors.
Content production. Consumer goods marketing requires enormous volumes of product content across retailer sites, marketplaces and channels, each with different format requirements. Generating and adapting product descriptions, imagery variants and localised copy is a high-volume, low-risk application where the baseline is manual and the review step is straightforward.
Product development support. Models can identify emerging ingredient and flavour trends from recipe data, retail listings and search behaviour earlier than traditional research cycles. This informs the pipeline rather than deciding it — the actual development still requires formulation, testing and regulatory work that no model shortens.
10. The data foundations
Every application above depends on data infrastructure, and this is where most consumer goods analytics programmes actually stall.
Product master data. The same product must be identifiable across your systems, your retailers' systems, and third-party data providers, each of which uses different codes. Building and maintaining that mapping is unglamorous, never finished, and blocks everything until it exists.
Retailer data. Point-of-sale and inventory data from retailers arrives in different formats, at different frequencies, with different definitions, and often through portals designed for human download rather than machine ingestion. Normalising this is a substantial ongoing engineering effort and is the single highest-value data investment most manufacturers can make.
Syndicated market data. Purchased panel and scanner data provides market share and competitor context. It has its own hierarchies and definitions that rarely match your internal ones, and reconciling them is a recurring source of disagreement about which number is correct.
Internal systems. Shipments, production, inventory and trade spend typically live in an enterprise system that was configured for finance rather than analytics. Extracting a clean, joined view is usually more work than the modelling that follows it.
The organisations that move fastest are those that treated this integration as a programme in its own right rather than as preparation for a modelling project. The data platform outlasts every individual model built on it.
11. Building the web platform underneath
The "web solutions" half of this topic is the delivery layer: the applications through which people actually use the models. Several patterns recur.
A planner's workbench presenting the forecast, its drivers, and the ability to override with a recorded reason. Overrides are not a failure — planners know things the model does not — but they must be captured, because comparing overridden to unoverridden accuracy tells you where the model is genuinely weak and where human intervention is destroying value.
A field application for sales representatives: store visit planning, photograph capture, immediate shelf analysis, and order entry. Offline capability is essential, because store back rooms have poor connectivity and a tool that fails there will not be used.
A trade promotion planning interface where a proposed promotion is simulated before commitment, showing expected uplift, cannibalisation and profitability. This is the application that most directly changes decisions, because it moves the analysis from a retrospective report to a forward-looking tool.
Retailer-facing portals sharing joint business planning data. These build the partnerships through which better data flows, which makes them strategically valuable beyond their immediate function.
The consistent design lesson across all of them: the model's output must arrive inside the workflow where the decision is made. A forecast in a separate dashboard that a planner must remember to consult will be ignored under time pressure. Embedded in the planning screen with its reasoning visible, it changes behaviour.
12. Measuring value honestly
| Application | Primary metric | Watch for |
|---|---|---|
| Demand forecasting | Error and bias at decision granularity | Aggregate accuracy hiding granular failure |
| Promotion optimisation | Incremental profit per promotion | Volume uplift mistaken for value |
| Assortment | Category value, not line sales | Delisting that loses the whole basket |
| Shelf intelligence | On-shelf availability | Photograph coverage too sparse to be representative |
| Inventory | Service level and waste together | Improving one by worsening the other |
| Direct-to-consumer | Data value and contribution margin | Revenue growth that loses money per order |
The recurring measurement trap is optimising a single metric that trades off against another. Service level improves trivially by holding more stock; waste falls trivially by holding less. Only measuring both together, with the financial value of each, produces decisions that are actually better.
13. Twelve failure patterns
- Forecasting shipments rather than consumption. Modelling your own ordering patterns instead of demand.
- Ignoring promotions in the baseline model. The series being forecast is dominated by events not in the model.
- Measuring forecast accuracy at aggregate level. Looks excellent, decisions still fail.
- Treating promotional uplift as incremental profit. Ignores forward buying, cannibalisation and the post-promotion dip.
- Delisting by sales rank. Removes products that anchor whole baskets.
- No product master data discipline. Every cross-system analysis becomes a reconciliation project.
- Point forecasts with blanket safety stock. Over-stocks the predictable, under-stocks the volatile.
- Shelf photographs too sparse to be representative. Confident conclusions from a biased sample.
- Direct-to-consumer justified on revenue. Disappointing volume and negative unit economics.
- Models delivered as dashboards. Not embedded in the decision, therefore not used.
- Overrides not recorded. No way to learn where the model or the human is wrong.
- Starting with modelling before data integration. The most common reason programmes stall for a year.
14. A worked example: one category, one year
Consider a mid-sized manufacturer in a chilled category with about forty products across three retailers. Their problem is stated as poor forecast accuracy; on investigation it turns out to be three separate problems that were being treated as one.
Quarter one is entirely data work. Product codes are mapped across internal systems, three retailer portals and one syndicated data provider — a mapping that turns out to have several hundred discrepancies, including two products that had been double-counted for a year. Retailer point-of-sale feeds are automated so they arrive daily rather than being downloaded manually each Monday. Nothing is modelled. The visible output is a single reconciled view of what actually sold, by store group, by week, which the commercial team immediately starts using because it did not previously exist.
Quarter two builds the baseline forecast. The first model is deliberately simple: seasonality, trend and known distribution changes, forecast at product and distribution-centre level, reconciled to the category total. It is compared against the existing planner-generated forecast, and it loses on about a third of products — specifically those where planners had knowledge the model did not, such as an upcoming listing. That comparison is the useful output, because it identifies exactly which information needs to become a model input rather than living in someone's head.
Quarter three adds promotions. The promotional calendar becomes a feature, and the model separates baseline from uplift. This is where accuracy improves materially, because roughly forty percent of the category's volume moves on promotion and the previous model was treating those weeks as noise. It also produces the first credible estimate of post-promotion dip, which had never been quantified and turns out to consume a substantial share of the apparent uplift.
Quarter four turns analysis into decisions. The promotion simulator goes into the trade planning workflow, so a proposed mechanic is evaluated for incremental profit before it is agreed with the retailer. Two regular promotions are found to be value-destroying once forward buying and cannibalisation are accounted for, and are renegotiated. Safety stock moves from a blanket two weeks to a per-product calculation based on forecast uncertainty, reducing both inventory and stockouts in the same quarter.
The pattern to take from this: the modelling was the smallest part, the data integration was the longest part, and the value was realised only when the output arrived inside a decision someone was already making.
15. Frequently asked questions
How much data history do we need to forecast?
Two to three years is a reasonable target, because you need several cycles of seasonality and a range of promotional patterns. Less can work for stable products; more helps if the category has multi-year cycles. What matters more than length is whether the history is clean and whether you know what happened during it — a year with a supply disruption or a packaging change is misleading unless those events are recorded as features.
Can we forecast new products with no history?
Not by extrapolation, but usefully by analogy. Models trained on the launch curves of comparable products, adjusted for distribution, pricing and marketing support, produce better estimates than judgement alone. Accuracy is inherently lower and should be presented as a wide range. The most valuable output is often not the number but the shape — how quickly a launch typically builds, and when the initial pipeline fill distorts the picture.
How do we get retailer data if we do not have it?
Through joint business planning relationships, which is a commercial conversation rather than a technical one. Retailers share data where they see mutual benefit — better availability, better range decisions, fewer supply problems. Bringing them a specific proposal with a demonstrated benefit works far better than a general request for data access. Syndicated market data is the fallback and is genuinely useful, though it is less granular and less timely.
Should planners be able to override the forecast?
Yes, always, with the reason recorded. Planners routinely know about a competitor launch, a supply constraint or a customer conversation that no model can see. What matters is measuring override performance: comparing overridden forecasts against what the model would have produced tells you where human input adds value and where it destroys it. In most organisations both happen, in identifiable patterns.
Is shelf image recognition worth the field team effort?
It depends on category dynamics. In categories where out-of-stock rates are high and shelf space is contested, the value is substantial and the payback is quick. In stable categories with reliable availability, it is expensive data collection for limited insight. Run it in a subset of stores first and measure whether the findings actually change what anyone does.
How should we handle promotional data quality?
Treat the promotional calendar as a first-class data asset with an owner, not as a spreadsheet passed around before each planning cycle. The most common cause of poor promotional modelling is that nobody can say exactly what mechanic ran, in which stores, on which dates. Recording that accurately, at the time, is worth more to your models than any algorithmic improvement.
Where should a manufacturer start?
Data integration, then forecasting, then promotions. Integration because everything depends on it and it takes longer than expected. Forecasting because it is measurable and drives operational decisions. Promotions because it is the largest under-managed spend and the analysis changes commercial negotiations. Shelf intelligence and direct-to-consumer are worth doing later, once the foundations exist and the organisation trusts the outputs.
How do we avoid a dashboard nobody uses?
Deliver into the workflow rather than alongside it. If a planner adjusts a forecast in a planning system, the model's output must appear there, with its reasoning and its confidence, at the moment they are deciding. A separate dashboard requires someone to remember it, open it, and reconcile it with what their main system says — which is three opportunities to skip it under time pressure, and they will be taken.
Glossary
| Term | What it means in this industry |
|---|---|
| Sell-in | What the manufacturer ships to the retailer. Reflects ordering behaviour, not consumer demand. |
| Sell-out | What the retailer sells to shoppers. The signal you actually want to forecast, and the one you usually do not own. |
| Baseline | The volume that would have sold without any promotional activity. Estimating it is the foundation of measuring anything. |
| Uplift | Incremental volume attributable to a promotion, above baseline. Frequently overstated because forward buying is counted as demand. |
| Forward buying | A retailer purchasing extra stock at a promotional price to sell later at full margin. Inflates the promotional period and depresses the next. |
| Pantry loading | Consumers stocking up during a promotion and buying less afterwards, producing a post-promotion dip. |
| Cannibalisation | Volume gained by one product at the expense of another in your own range, rather than from a competitor. |
| On-shelf availability | Whether the product is physically present and findable. Distinct from warehouse stock, and invisible in sales data. |
| Planogram | The agreed shelf layout. Compliance with it is often paid for and frequently not verified. |
| Trade spend | Money paid to retailers for price support, features and displays. Typically among the largest and least measured lines in the business. |
| Syndicated data | Purchased market measurement covering competitors and category share, with its own hierarchies that rarely match yours. |
| Price pack architecture | The structure of pack sizes and price points across a range, and how shoppers substitute between them. |
Two of these deserve extra emphasis because they cause the most measurement error. Sell-in versus sell-out determines whether you are modelling demand or modelling your own supply chain — teams that forecast sell-in and call it demand forecasting are optimising the wrong series. And baseline is the quantity everything else is measured against; a promotion evaluated without a credible baseline is a story rather than an analysis, and the story is almost always more flattering than the truth.
Key takeaways
- The data problem is bigger than the modelling problem. Product master data and retailer feeds gate everything.
- Forecast consumption, not shipments, at the granularity decisions are actually made.
- Promotions dominate demand. Model baseline, uplift, cannibalisation and post-promotion dip together, or measure nothing useful.
- Lost sales are invisible in your data. Shelf intelligence exists to see what your sales reports structurally cannot.
- Probabilistic forecasts beat point forecasts. Per-product safety stock reduces inventory and stockouts simultaneously.
- Deliver into the decision. A model in a separate dashboard is a model nobody uses.
Consumer goods rewards marginal improvement more than almost any other industry, because the volumes turn a fraction of a percent into a substantial number. That is an argument for patience with the unglamorous foundations rather than for ambitious models — the manufacturers seeing real returns are the ones who fixed their data first and then applied ordinary techniques exceptionally well.
Enjoyed this article?
Get more engineering insights from ELIVTECH — or talk to us about your project.
Get in touch