Should tasks stop executing when stack overflows?

I actually created 2 tasks, one a higher priority and another a lower priority. If I create the lower priority task first, the stack overflows but the execution don’t stop. But if higher priority is created first stack overflows , but the program crashes.