Summary: Automated Testing Summit 2018

Chris Fiege | | Event

The Automated Testing Summit (ATS) was a co-located event at the ELC-E 2018 in Edinburgh. The summit was organized by Tim Bird and Kevin Hilman and brought together over 35 (embedded) testing experts from different projects and companies.

The Idea

At ELC-E 2017 Andrew Murray did his BoF Farming Together. This BoF showed that lots of companies and individuals in the embedded world are running some kind of board farm: They all have the need to remote-control real hardware and test software on that hardware.

During the discussion the idea of more collaboration in this area arose. Tim Bird suggested to collect e-mail addresses in the Wiki. Afterwards, the existing automated-testing mailing list run by the Yocto Project was used for further coordination.

The Summit

During the next year, Tim Bird and Kevin Hilman organized the Automated Testing Summit as a co-located event during the ELC-E 2018. Linaro and DENSO TEN sponsored the summit.

The summit brought together 35 testing experts from over 22 projects. Most of the people represented testing of embedded devices. But some also represented high-level projects that test software without hardware. has a list of represented projects.

During eight hours of productive discussion, we worked on:

  • defining a common terminology and reference testing workflow
  • identifying interfaces where we could share test suites, build and test artifacts (by creating an interchange format)
  • learning how other board farms are built and used
  • and many smaller topics

(For some attendees the discussion even continued in a pub near the venue.) The minutes are available on the wiki as well.

Action Items

Taking into account the number of companies, projects and individuals involved in the summit the list of resulting action items is quite long. The summit also showed that there are even more possibilities to collaborate in testing -- even if some parts of the process are proprietary.

In the short term, the following action items will probably have the most relevance for us at Pengutronix.


All projects that need to control embedded hardware switch the board's power supply in one or another way. The attendees agreed that a common interface would help all projects: a driver only has to be developed once. The idea is to support pdudaemon as the common interface to control power switches and to upstream drivers for new switches to pdudaemon.

Design for Testing Document

The attendees agreed that a design for embedded testing document could help test engineers to communicate with the hardware developers. The document should describe measures that ensure software development and automated testing are possible.

Since the Automated Testing has no formal body yet, the document could be signed by multiple projects, companies and individuals that support its contents.

I volunteered to coordinate the creation of the document. I will post an update as soon as there are any resources available online.

Next meeting

The attendees agreed that we would like to meet again next year. The meeting will probably be during the ELC-E 2019 in Lyon, France.

Further Readings

CLT-2022: Voll verteilt!

Marie Mann | | clt, event, linux, talk, tutorial

Unter dem Motto "Voll verteilt" finden die Chemnitzer Linux Tage auch 2022 im virtuellen Raum statt. Wie auch im letzten Jahr, könnt ihr uns in der bunten Pixelwelt des Workadventures treffen und auf einen Schnack über Linux, Open Source, oder neue Entwicklungen vorbei kommen.

Smart City - vom Rapid Prototyping bis zur Tragfähigen Infrastruktur

Wir wollen zum Bundesweiten Digitaltag am 18.6.2021 das Thema "Smarte Städte" ein bisschen von der technischen Seite beleuchten, aber keine Angst: es bleibt für alle verständlich.

Yocto Project Virtual Summit 2021

Enrico Jörns | | Event, Yocto
On Tuesday, 25th and Wednesday, 26th, the 3rd edition of the Yocto Project Virtual Summit took place on the internet. With a fair ticket price of 40$ Pengutronix developers Jan Lübbe and Enrico Jörns got a 2-day long wild ride through the latest features, workflows and experiences with the Yocto Project.