Skip to article frontmatterSkip to article content
Site not loading correctly?

This may be due to an incorrect BASE_URL configuration. See the MyST Documentation for reference.

3.2 Sensing Vessels: What Do the Sensors Say?

Source

Section 3.1 showed that a perfect sensor could save up to 0.90 cost units per vessel. No real sensor is perfect, so the questions now are: which real sensors should the robot have, how should it combine them, and how much of the 0.90 do they actually recover?

Three sensors at the sink

The engineers have fitted three inexpensive sensors:

SensorWhat it measuresWhy it helps
Camerathe vessel’s height-to-width ratio from its outlineplates are flat, tumblers are tall, bowls and kadais are in between
Load cell (scale)weight in gramsa cooking vessel is far heavier than a plate or bowl
Grease sensorwhether the pre-rinse water turns cloudy with oilcooking vessels are usually greasy

Each sensor was tested on hundreds of labelled vessels, and its behaviour was summarised as a sensor model p(z∣x)p(z \mid x), as in Section 2.2. The camera ratio and the weight are modelled as Gaussians, with a different mean and spread for each vessel type. The grease sensor is binary, so its model is one probability per type.

<Figure size 1320x352 with 3 Axes>

Look at where the curves overlap, because that is where each sensor will struggle:

  • The camera separates flat plates and tall tumblers well, but bowls (0.45) and cooking vessels (0.40) have almost the same shape.

  • The scale separates heavy cooking vessels from everything else, but plates (180 g) and bowls (150 g) weigh about the same.

  • The grease sensor fires for 90% of cooking vessels, but also for about a third of plates and bowls with leftover sambar or oil.

Each sensor is weak somewhere different. That is exactly the situation where combining them pays off.

Combining sensors: naive Bayes

Suppose the sensors’ errors are independent given the vessel type: once we know a vessel is a kadai, its weight tells us nothing extra about its camera ratio or its greasiness. Then, just as with the camera and GPS in Section 2.3, the posterior is the prior multiplied by one likelihood per sensor:

P(x∣zcam,zwt,zgr)  ∝  P(x)  p(zcam∣x)  p(zwt∣x)  P(zgr∣x)P(x \mid z_{\text{cam}}, z_{\text{wt}}, z_{\text{gr}}) \;\propto\; P(x)\; p(z_{\text{cam}} \mid x)\; p(z_{\text{wt}} \mid x)\; P(z_{\text{gr}} \mid x)

This is called naive Bayes. It is “naive” because it assumes independence even when that is only roughly true, but it is simple, fast, and needs only one small model per sensor. Once we have the posterior, the robot picks the programme with the lowest expected cost, using the posterior in place of the prior:

a⋆=arg⁡min⁡a∑xP(x∣z) C(a,x)a^\star = \arg\min_a \sum_x P(x \mid z)\, C(a, x)

Worked example: a heavy, greasy, medium-deep vessel

A vessel arrives. The grease sensor says greasy, the camera reports a ratio of 0.55, and the scale reads 820 g. We add the evidence one sensor at a time and watch the belief change:

                 prior: plate 0.400  tumbler 0.250  bowl 0.200  cooking 0.100  other 0.050
    + grease: "greasy": plate 0.384  tumbler 0.040  bowl 0.224  cooking 0.288  other 0.064
  + camera: ratio 0.55: plate 0.000  tumbler 0.000  bowl 0.515  cooking 0.416  other 0.069
        + scale: 820 g: plate 0.000  tumbler 0.000  bowl 0.000  cooking 1.000  other 0.000
<Figure size 1320x319 with 4 Axes>

Figure 1:Belief about one vessel as each sensor’s evidence is added. Grease alone shifts belief toward cooking vessels, the camera rules out plates and tumblers, and the weight settles it.

Follow the reasoning step by step:

  1. Prior. Plates are most likely (0.40), so the robot would run standard.

  2. Grease says “greasy”. Belief in cooking vessel jumps from 0.10 to about 0.29, but plates and bowls with oily leftovers are still likely. The decision stays standard.

  3. Camera ratio 0.55. Plates (0.10) and tumblers (1.30) can’t produce this shape, so they drop to almost zero. Now it is bowl (about 0.52) versus cooking vessel (about 0.42).

  4. Scale 820 g. No bowl weighs anywhere near that much. The belief in cooking vessel goes to almost 1, and the robot runs heavy degrease.

No single sensor could have done this alone. The camera could not tell bowl from kadai, and grease alone did not change the decision. Together they are decisive.

A second example: light, shallow, and clean

The next vessel is not greasy, has a ratio of 0.30, and weighs 170 g. What does each sensor say on its own, and what do they say together?

  scale only (170 g): plate 0.67, bowl 0.31  →  standard (exp. cost 2.06)
  camera only (0.30): bowl 0.49, cooking 0.44  →  heavy degrease (exp. cost 3.93)
 grease only (clean): plate 0.41, tumbler 0.35  →  standard (exp. cost 2.22)
           all three: bowl 0.96, other 0.04  →  standard (exp. cost 2.11)

On its own, the camera is torn between bowl and cooking vessel (both are medium-deep), and because a mistake on a kadai is costly, it plays safe with heavy degrease. That is the right call given what it knows, but an expensive one. The scale alone thinks plate is likelier than bowl. Together, the evidence points clearly to a bowl, and the robot runs standard.

Which sensors are worth installing?

To compare sensor combinations fairly, we simulate thousands of vessels and let the robot use only some of its sensors. We record two numbers: accuracy (how often the most probable type is correct) and average cost (what the robot actually pays).

                 sensors | avg cost | accuracy
                    none |     2.77 |   40.1%
                  grease |     2.77 |   40.1%
                   scale |     2.08 |   71.5%
                  camera |     2.43 |   85.3%
         camera + grease |     2.23 |   87.4%
          camera + scale |     1.96 |   97.1%
 camera + scale + grease |     1.95 |   97.3%
                  oracle |     1.86 |
<Figure size 880x396 with 1 Axes>

Figure 2:Average cost per vessel for each sensor combination (bars), between the no-sensor cost and the oracle floor (dashed lines). Accuracy is printed on each bar. The camera alone is more accurate than the scale alone, yet costs more.

Three lessons stand out in Figure 2.

1. Accuracy is not the same as cost. The camera alone identifies the vessel correctly more often than the scale alone (about 85% against 72%), yet the scale alone gives a lower cost. The scale’s mistakes are cheap: it confuses plates with bowls, which get the same programme anyway. The camera’s mistakes are expensive: it confuses bowls with kadais, forcing costly heavy degrease “just in case”. Judge a sensor by the decisions it improves, not by how often it is right.

2. A sensor can be informative yet useless alone. The grease sensor on its own leaves the cost exactly where it was with no sensors. It does change the robot’s belief, but never enough to change the decision: whatever it reports, standard stays the best choice. This is the value-of-information idea from Section 2.4: information only has value if it can change what the robot does. Combined with the camera, however, the grease sensor does help, because it tips the camera’s bowl-versus-kadai dilemmas.

3. The right pair gets close to the floor. Camera plus scale recovers most of the 0.90 gap, and adding the grease sensor adds only a sliver more. Whether the third sensor is worth its price, maintenance, and cleaning depends on how much that sliver is worth over thousands of vessels.