Researchers Find Use for Smartphones in 3D Model Creation

Researchers at Carnegie Mellon University in Pittsburgh have discovered they can use a simple smartphone as a measurement device in the creation of 3D models. By moving a smartphone from side to side or back and forth while either using video or simply switching the phone's screen orientation from portrait to landscape, the user can get a sense of an object's real size.

While video from smartphones and other devices have been used in creating 3D models for some time, this is the first time they have also been used to determine the scale of models — by taking advantage of relatively inexpensive inertial measurement units (IMU).

"We've been able to get accuracies with cheap sensors that we hadn't imagined," said Simon Lucey, an assistant research professor at the Carnegie Mellon University Robotics Institute, where the research on using smartphones in 3D model creation is being conducted.

For instance, Lucey pointed out, with a facetracker program, they have been able to measure the distance between a person's pupils within half a millimeter, making it possible to go virtual shopping for eyeglass frames.

More than 30 years ago, researchers at Carnegie Mellon pioneered the use of 2D images or video to build increasingly accurate 3D models, but taking scale into account has always been a challenge.

But now, as smartphones incorporate higher frame-rate video cameras, the accuracy of the technique will become even better.

"With a high frame-rate camera," Lucey said, "we can excite the IMU by moving the phone faster, without corrupting the image."

Eventually, he said he believes, similar low energy-consuming techniques will be used with robots and self-driving cars rather than the power-hungry technologies like radar and laser rangefinders now being experimented with.

About the Author

Michael Hart is a Los Angeles-based freelance writer and the former executive editor of THE Journal.

Featured

  • large group of college students sitting on an academic quad

    Student Readiness: Learning to Learn

    Melissa Loble, Instructure's chief academic officer, recommends a focus on 'readiness' as a broader concept as we try to understand how to build meaningful education experiences that can form a bridge from the university to the workplace. Here, we ask Loble what readiness is and how to offer students the ability to 'learn to learn'.

  • Abstract speed motion blur in vibrant colors

    3 Ed Tech Shifts that Will Define 2026

    The digital learning landscape is entering a new phase defined by rapid advances in artificial intelligence, rising expectations for the student experience, and increasing pressure to demonstrate quality and accountability in online education.

  • abstract illustration of data infrastructure

    IBM to Acquire Data Infrastructure Firm Confluent in AI Push

    IBM has agreed to buy data infrastructure company Confluent for $11 billion in cash, marking the technology giant's largest acquisition in years as it seeks to capitalize on surging enterprise demand for artificial intelligence capabilities.

  • glowing crystal ball with network connections

    Tech Outlook 2026: What Higher Ed Tech Leaders Expect this Year

    We asked higher education technology leaders for their predictions on how the tech landscape will change for colleges and universities in the coming year. Here's what they told us.