mirror of
https://github.com/OpenEPaperLink/OpenEPaperLink.git
synced 2026-03-21 00:04:28 +01:00
[GH-ISSUE #204] Mini-ap hangs on an almost daily basis #3424
Assignees
sascha_hemi
Clear assignees
sascha_hemi
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: starred/OpenEPaperLink#3424
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @mooseroy on GitHub (Jan 16, 2024).
Original GitHub issue: https://github.com/OpenEPaperLink/OpenEPaperLink/issues/204
Describe the bug
Bought a mini-ap and a bunch of tags from tindie, and for the most part they work perfectly, updating about 10 tags on an hourly basis, and another 15 daily using the homeassistant plugin. The issue is that it seems like every other day, the mini-ap will simply stop updating tags. Trying to ping or connect to the mini-ap's web server with the browser fails as well. I have to physically unplug and plug back in the ap to get it to respond again. Looking at the log.txt after the hard reboot shows multiple Reboot. Reason: Panic message daily, but then a big gap until I do the hard reboot.
This has happened on all versions sinceI started using the mini-ap and tags.
Was hoping there was more debugging or information I could extract that would help to fix the issue.
Expected behavior
System stays online and doesn't hang during the day requiring a hard reboot.
Additional context
Version:
env: ESP32_S3_16_8_YELLOW_AP
build date: 2024-01-09 15:42
esp32 version: 2.07b
filesystem version: 2.07b
psram size: 8379015
flash size: 16777216
Tail end of log:
2024-01-15 11:20:46 http imageUpload 000002cafd854834.jpg
2024-01-15 11:21:02 http imageUpload 000002b842774838.jpg
2024-01-15 11:37:07 Reboot. Reason: Panic
2024-01-15 11:37:08 Connecting to WiFi...
2024-01-15 11:37:10 Connected!
2024-01-15 11:37:00 00004C6E913BDAEC Booting
2024-01-15 12:00:02 http imageUpload 0000021f82ad3b18.jpg
2024-01-15 12:00:19 http imageUpload 0000021a47163b14.jpg
2024-01-15 12:00:31 http imageUpload 0000021b6d403b1e.jpg
2024-01-15 12:00:43 http imageUpload 0000021eee7a3416.jpg
2024-01-15 12:00:54 http imageUpload 0000021f2ff63b11.jpg
2024-01-15 12:01:04 http imageUpload 000002caff024839.jpg
2024-01-15 12:01:16 http imageUpload 000002cafd854834.jpg
2024-01-15 12:01:29 http imageUpload 000002b842774838.jpg
2024-01-15 13:00:00 http imageUpload 0000021f82ad3b18.jpg
2024-01-15 13:00:14 http imageUpload 0000021a47163b14.jpg
2024-01-15 13:00:26 http imageUpload 0000021b6d403b1e.jpg
2024-01-15 13:00:37 http imageUpload 0000021eee7a3416.jpg
2024-01-15 13:00:49 http imageUpload 0000021f2ff63b11.jpg
2024-01-15 13:01:00 http imageUpload 000002caff024839.jpg
2024-01-15 13:01:12 http imageUpload 000002cafd854834.jpg
2024-01-15 13:01:23 http imageUpload 000002b842774838.jpg
2024-01-15 13:17:30 Reboot. Reason: Panic
2024-01-15 13:17:31 Connecting to WiFi...
2024-01-15 13:17:33 Connected!
2024-01-15 13:17:39 00004C6E913BDAEC Booting
2024-01-15 14:00:03 http imageUpload 0000021f82ad3b18.jpg
2024-01-15 14:00:15 http imageUpload 0000021a47163b14.jpg
2024-01-15 14:00:26 http imageUpload 0000021b6d403b1e.jpg
2024-01-15 14:00:37 http imageUpload 0000021eee7a3416.jpg
2024-01-15 14:00:50 http imageUpload 0000021f2ff63b11.jpg
2024-01-15 14:01:02 http imageUpload 000002caff024839.jpg
2024-01-15 14:01:16 http imageUpload 000002cafd854834.jpg
2024-01-15 14:01:28 http imageUpload 000002b842774838.jpg
2024-01-15 15:19:35 http imageUpload 0000021f82ad3b18.jpg
2024-01-15 15:20:35 http imageUpload 0000021a47163b14.jpg
2024-01-15 15:21:36 http imageUpload 0000021b6d403b1e.jpg
2024-01-15 15:22:09 http imageUpload 0000021eee7a3416.jpg
2024-01-15 15:22:24 http imageUpload 0000021f2ff63b11.jpg
2024-01-15 15:22:35 http imageUpload 000002caff024839.jpg
2024-01-15 15:22:46 http imageUpload 000002cafd854834.jpg
2024-01-15 15:22:59 http imageUpload 000002b842774838.jpg
19:00:01 Reboot. Reason: Power-on
19:00:02 Connecting to WiFi...
19:00:03 Connected!
19:00:09 00004C6E913BDAEC Booting
2024-01-15 19:47:22 http imageUpload 0000021f82ad3b18.jpg
2024-01-15 19:48:11 http imageUpload 0000021a47163b14.jpg
2024-01-15 19:48:22 http imageUpload 0000021b6d403b1e.jpg
2024-01-15 19:48:36 http imageUpload 0000021eee7a3416.jpg
2024-01-15 19:48:55 http imageUpload 0000021f2ff63b11.jpg
2024-01-15 19:49:09 http imageUpload 000002caff024839.jpg
2024-01-15 19:49:22 http imageUpload 000002cafd854834.jpg
2024-01-15 19:49:41 http imageUpload 000002b842774838.jpg
2024-01-15 19:49:56 http imageUpload 0000021f82ad3b18.jpg
2024-01-15 19:50:11 http imageUpload 0000021a47163b14.jpg
2024-01-15 19:50:22 http imageUpload 0000021b6d403b1e.jpg
2024-01-15 19:50:33 http imageUpload 0000021eee7a3416.jpg
2024-01-15 19:50:49 http imageUpload 0000021f2ff63b11.jpg
2024-01-15 19:51:04 http imageUpload 000002caff024839.jpg
2024-01-15 19:51:16 http imageUpload 000002cafd854834.jpg
2024-01-15 19:51:28 http imageUpload 000002b842774838.jpg
2024-01-15 19:51:39 http imageUpload 0000021f82ad3b18.jpg
2024-01-15 19:51:50 http imageUpload 0000021a47163b14.jpg
2024-01-15 19:52:07 http imageUpload 0000021b6d403b1e.jpg
2024-01-15 19:52:16 http imageUpload 0000021eee7a3416.jpg
2024-01-15 19:52:27 http imageUpload 0000021f2ff63b11.jpg
2024-01-15 19:52:41 http imageUpload 000002caff024839.jpg
2024-01-15 19:52:54 http imageUpload 000002cafd854834.jpg
2024-01-15 19:53:05 http imageUpload 000002b842774838.jpg
2024-01-15 19:53:16 http imageUpload 0000021f82ad3b18.jpg
2024-01-15 19:53:27 http imageUpload 0000021a47163b14.jpg
2024-01-15 19:53:41 http imageUpload 0000021b6d403b1e.jpg
2024-01-15 19:53:52 http imageUpload 0000021eee7a3416.jpg
2024-01-15 19:54:03 http imageUpload 0000021f2ff63b11.jpg
2024-01-15 19:54:15 http imageUpload 000002caff024839.jpg
2024-01-15 19:54:27 http imageUpload 000002cafd854834.jpg
2024-01-15 19:54:37 http imageUpload 000002b842774838.jpg
2024-01-15 20:00:03 http imageUpload 0000021f82ad3b18.jpg
2024-01-15 20:00:17 http imageUpload 0000021a47163b14.jpg
2024-01-15 20:00:29 http imageUpload 0000021b6d403b1e.jpg
2024-01-15 20:00:40 http imageUpload 0000021eee7a3416.jpg
2024-01-15 20:00:53 http imageUpload 0000021f2ff63b11.jpg
2024-01-15 20:01:04 http imageUpload 000002caff024839.jpg
2024-01-15 20:01:15 http imageUpload 000002cafd854834.jpg
2024-01-15 20:01:26 http imageUpload 000002b842774838.jpg
@jjwbruijn commented on GitHub (Jan 16, 2024):
What happens if you only generate content for tags from within the webinterface, and don't send any jpegs?
@mooseroy commented on GitHub (Jan 16, 2024):
I'll set all the tags to show current date in the web interface, and let you know in a day or two if it happens with said setting.
@mooseroy commented on GitHub (Jan 17, 2024):
I ran all day yesterday with the 30 of the tags set to show current date, and 4 showing weather, all driven from the web interface, no home assistant involved. Checked the log file this morning and saw 1 reboot panic:
@mooseroy commented on GitHub (Jan 18, 2024):
The mini-ap still hasn't hung using only web interface driven updates. I'm going to start pushing 3 of the updates from home assistant to see how long it takes for it to hang, and if there is any correlation between the number of updates from home assistant and the time it takes to hang.
@mooseroy commented on GitHub (Jan 18, 2024):
I'm not sure if this helps in any way, but I did have a console logger connected today when it rebooted due to a panic:
@mooseroy commented on GitHub (Jan 19, 2024):
Turning back on the updating of around 20 tags once per hour caused a panic. I had a putty log attached all day, and this was at the tail end of the log before the panic.
@mooseroy commented on GitHub (Jan 20, 2024):
Just adding a couple more traces from panics:
@nlimper commented on GitHub (Jan 20, 2024):
If you're running platformio/vscode, you can connect the terminal output there. It will automatically decode the stack trace (the 'backtrace' in the crashes, displaying the exact position in the script. I have no clue about the
CORRUPT HEAPerror, I haven't seen it in my devices.I'm currently improving some parts of the image upload script to make it more robust. But I'm not sure if they will solve your corrupt heap crashes, as I don't know yet what the origin is.
@mooseroy commented on GitHub (Jan 20, 2024):
Thanks. Just installed platformio, so will connect up the terminal and see if it provides anything useful.
@mooseroy commented on GitHub (Jan 20, 2024):
Here is the backtrace. Again, thanks for any help.
@nlimper commented on GitHub (Jan 21, 2024):
Try this one!
83bd0ec177@mooseroy commented on GitHub (Jan 21, 2024):
Thanks. Pulled and built that commit and uploaded to AP. Will monitor it over the next day to see how it goes and let you know.
@mooseroy commented on GitHub (Jan 22, 2024):
So far this is working much better. I'll let it run the rest of the day and close the issue if nothing panics. Thanks for all the help.