Unit testing user code that depends on FreeRTOS

Libraries
#1

[Note: this is NOT about unit testing FreeRTOS itself: that’s been well covered in other posts.]

I’m re-architecting a project that makes extensive use of FreeRTOS. For modules that don’t depend on FreeRTOS, there is (nearly) 100% unit test coverage – that’s good.

But for modules that make use of FreeRTOS, I’m trying to figure out the best testing strategy.

I could set up a minimal FreeRTOS environment for testing, but to avoid conflicts with the production FreeRTOS, I’d have to generate an entirely new project.

What strategies have people used for unit testing code that depends on FreeRTOS?

#2

You can use some mocking framework like CMock to mock out FreeRTOS APIs. However, multi-threading (thread safety, sequencing, etc.) is hard to cover with CMock.

You can look here for an example of using CMock: https://github.com/aws/amazon-freertos/blob/master/libraries/abstractions/secure_sockets/utest/secure_sockets_utest.c

Thanks.

#3

Based on other (non-FreeRTOS) work I’ve been doing, I’ve come to believe that the best testing strategy is to do unit testing on a workstation / laptop to cover the bulk of the code. The remaining hardware validation can be handled by a small dedicated app running on the target system.

Here’s how you’d do unit testing on a workstation / laptop:

  • Start with FreeRTOS Windows Port or one of the Linux / macOS equivalents.
  • Separate out all the real-time functionality, call what remains to be the “VM layer”. For example, rather than driving the RTC, the VM layer should ONLY provide a means to set the RTC count and to generate an RTC interrupt. Ditto for serial data, button pushes, etc.
  • A separate layer would link the VM layer to the actual Windows / Linux / macOS system, e.g. with a real timer / counter, serial driver, etc.

The point of separating out the vm layer is that you could now control the state of your FreeRTOS app using a unit test harness: there would no longer be any real time constraints in your testing code, and in fact, your test code could precisely manipulate virtual time and other asynchronous operations.

I’d welcome a chance to discuss this with the maintainers of the FreeRTOS simulators. This wouldn’t require much creation of new code: rather it would be a refactoring of what’s there.

#4

hello,
I am trying to understand the shared example, is there any link or help you can provide for same.

#5

Are you asking for CMock documentation? If so, you can check CMock docs here: https://github.com/ThrowTheSwitch/CMock/tree/master/docs

Thanks.

#6

Thanks aggarg,
Please provide some help with some steps:

  1. i have one project which is successfully cross compiling for esp32.
  2. but when i trying to compile it with ceedling it shows lot of errors.
  3. shall we use cross compiler with ceedling, and how to configure it ?
  4. if any other way around, what i have missed.

please help on this.

Thanks

#7

I am trying to do unit testing through ceedling using esp32 compiler in my project and getting error Errno::EACCES: Permission denied please help if anyone can.

#8

Is this a FreeRTOS question?

#9

I have not used ceedling myself and therefore I cannot help with it. I’d suggest reaching out to ceedling maintainers.

Thanks.

#10

yes project depends on freertos