Instrumented People, Places and Things
Start here
Iota Partners was a research firm in Chicago, from 2010, that helped clients understand products and services in use. It built sensors and other instruments to understand behavior in the contexts of everyday life and to model it, for the development and evaluation of products, services and communications. The agency SapientNitro acquired it in 2012, and the work continued there.
This is a collection of case studies from that work. A selection replays in the browser.
In TJ's words:
“We were thinking about understanding the world and building computational models of behaviors to provide richer context for design.”
“A framework for doing so was anchoring the activity from the perspective of the person, place, or thing.”
“In exploring hypotheses METIS and other techniques were used to bridge and map evidence of activities to sensing.”
A 2013 methods document calls METIS “a tool for defining measurable components of a high level, abstract concept”.
Start with
- 2012Iota open house. A lab full of visitors, for an hour, in a 3D model.
- 2014Measuring Engagement. A walk to a coffee shop, through Google Glass.
- 2014Instrumented Homes ↗ TJ's kitchen, and the models of object use built from it.
- 2026Modeling Activity. Slides from a talk on computational design and AI applications.
More studies
- 2011Napkin dispenser. When a dispenser's module was touched, in a small coffee shop, and the shop as a model.
- 2011Candy bag. How a bag of candy is eaten, followed by a sensor pack on the bag, as a proof of concept.
- 2011–12Device ecosystems. Which devices people called into action, and how their attention moved.
- 2012Bottle cams. Four spray bottles in three homes: one bottle's journey by room, and how a use looks.
- 2012UIC Innovation Lab. A demo built for the Lab, replaying a meeting in the Iota office.
- 2012Office day. 21 sensors around the Iota office through one working day, replayed as the team's viewer drew them.
- 2012Office socialization. Containers of candy across a company's offices, and the team's tool running on the readings that survive.
- 2012–13Aging in place. One home, its instruments, and what each was meant to read.
- 2013–14Measuring collaboration. An instrumented office, and the one day of its readings that survives.
- 2013–14Pockets. Days in the life of a person, behind a sign-in.
- 2014Office beacons. iBeacons on two floors of the office: every track under a label, TJ's as TJ's.
Each page credits its own study. Most of the sensing and instruments were the Iota team's, at SapientNitro. The object-use models on the kitchen page are TJ's, from 2026. Client studies appear without their clients' names.
Anchors
| People | a person over time | 2 |
|---|---|---|
| Places | the sensors stay put; the people and stuff in view change | 8 |
| Things | the object itself is the focus | 5 |
A filled dot is what a study is mainly about; a hollow one is what it also touches. A faint bar on the timeline means only the year is known.
Activity runs through all three. TJ: “Activity is not a 4th idea, it is what is common across all three. Models of activity.” So each study is listed with its model of activity.
Studies
| Study | When | Anchors | Instruments | Model of activity | Notes |
|---|---|---|---|---|---|
| People | |||||
| Measuring Engagement: the walk to Intelligentsia | 3 Apr and 15 May 2014 | Google Glass worn by TJ: camera, sound, light, orientation, acceleration; a follow-along camera | A provocation: what might engagement look like? Head turns, steps and light along the path | ||
| Pockets | Dec 2013 – Jul 2014 | RescueTime on TJ's phone and computers, Moves, Fitbit steps, Basis | Days as patterns of place, movement and screen time (to build) | sign-in required | |
| Places | |||||
| Iota open house | 24 Oct 2012, 16:00–17:00 | 4 Kinects, 3 Grid-EYEs, 4 spiders | People, movement, hot spots and sound over an hour | ||
| Instrumented Homes (TJ's kitchen) ↗ | Jul 2014 – Apr 2015 | SmartThings sensors on kitchen objects; surveys sent when activity stopped | Object-use models: drink, cleaning, someone else, other | ||
| UIC Innovation Lab | 16 Jul – 3 Aug 2012 | One Kinect in a 3D model of a floor: a depth frame and tracked positions | Stops at observation: where tracker ids were in a room, one point each, at an office meeting | ||
| Office day | 17 Aug 2012 | 8 Bluetooth loggers, 3 Kinects, 4 Grid-EYEs and 6 spiders around the Iota office | Stops at observation: coarse device tracks, which loggers heard which device, through one working day | ||
| Office beacons | May – Nov 2014 | About 150 iBeacons on two floors and iPods worn on the arm; then seven fixed iPods and carried beacons | Device-level tracks and dwell across the two floors | ||
| Office socialization | 24 Sep – 14 Nov 2012 | Instruments under 24 containers of candy across a company's offices: weight, temperature, pressure, sound | Socialization, with taking candy as its trace: who stops, when, alone or together | fragments of the readings survive | |
| Aging in place | Dec 2012 – Jan 2013 | A Kinect, a Grid-EYE and four spiders; scales planned | Daily living, mapped item by item to rooms and sensors, from the Katz and Lawton lists | readings not found | |
| Measuring collaboration | May–Jun 2013; Feb–Aug 2014 | 2013: Grid-EYE thermal cameras, spiders (seven sound bands, temperature, pressure), table-top buttons, a mobile survey, RescueTime, a Kinect. 2014: IP camera, microphone, Netatmo, SmartThings | Meeting types from sound and motion; turn-taking, from one way to collaborative (students). One instrument's day survives | ||
| Things | |||||
| Napkin dispenser | Nov 2010 – Mar 2011 | Wireless modules with an accelerometer and plug-in sensors on dispensers in a small independent coffee shop; a webcam, withheld | When a dispenser's module is touched, and how often; not how many napkins | pictures withheld | |
| Candy bag | May – Jul 2011 | A sensor pack moved from bag to bag: touch on six copper plates and movement; with GPS, participant video and in-home interviews | How a bag is eaten: in one sitting or not, at home or not, poured or picked; the readings reach the first two in part | ||
| Device ecosystem pilot | Aug – Sep 2011 | Accelerometer loggers on a PC, a phone, a tablet, a table and two chairs; Bluetooth loggers and a beacon; GPS | Where a person's devices go, and which travel together | ||
| Device ecosystems | Nov 2011 – Mar 2012 | Accelerometer loggers and application logging on laptops, phones and tablets; GPS; Bluetooth; a device logger; interviews and a diary app | Which devices and accessories are called into action for a goal, in a context: attending, tacking, darting | ||
| Bottle cams | Jun 2012 | Cameras with sound and accelerometers on household cleaning products, recording when they moved; in three homes | The product's journey: out of storage, used, kept out or put back | footage withheld | |