HttpClient crashes after HTTP request #3659

KenthJ · 2020-01-23T15:38:53Z

Board: ESP-WROOM-32
IDE name: Arduino IDE version 1.0.4
Flash Frequency: 80Mhz
PSRAM enabled: No
Upload Speed: 921600
Computer OS: Windows 10

Hi

Please bear with me, I'm completely new in this ESP32 world.

I'm trying to make a very simple HTTP request from my ESP32 towards a webserver which is running on a Raspberry Pi running Win 10 IOT, I have been banging my head for several hours and days trying to solve my problem below.

In most cases the code succeeds getting a response as expected, but when I call http.end() it crashes, sometimes with Guru Meditation Error: Core 1 panic'ed (InstrFetchProhibited), other times with (LoadProhibited).

If I instead use any other URLs instead of my own webserver, everything works fine.
When I test the URL of my Raspberry PI webserver with a normal internet browser on my PC, or using Fiddler everything works fine too.

The strange thing is that it only crashes when it sends a http req to my homemade webserver, it works fine with all other webservers.

I double checked my http header from the server, and also added "Content-Type: text/html" "Date:....." and "Server:..." to the header.

Further more I checked the header and html response using a program called Fiddler and using FireFoxs Inspector tool, and I really can't see any problem with it, but there must be something in the response from my webserver causing the crash

#include <WiFi.h>
#include <HTTPClient.h>
 
const char* ssid = "mySSID";
const char* password =  "myPassword";

void setup(void)
{
  Serial.begin(9600);
  delay(4000);

  WiFi.begin(ssid, password);
 
  while (WiFi.status() != WL_CONNECTED) {
    delay(1000);
    Serial.println("Waiting for Wifi");
  }
 
  Serial.println("Wifi connected");
  delay(1000);
}



void loop()
{ 
  if ((WiFi.status() == WL_CONNECTED)) //Check the current connection status
  {  
    HTTPClient http;;

    bool httpInitResult = http.begin("http://192.168.0.105:485/esp32.html");

    http.addHeader("Content-Type", "text/html");

    if( httpInitResult == false )
    {
      Serial.println("http.begin() failed!");
    }
    else
    {
      int httpCode = http.GET();
    
      Serial.print("httpCode: ");
      Serial.println(httpCode);
     
      if (httpCode > 0) //Check for the returning code
      { 
        String payload = http.getString();
    
        Serial.print("Payload: ");
        Serial.println(payload);
      }
      else 
      {
        Serial.println("Error on HTTP request");
      }
    }
    Serial.println("Trace just before http.end()");
    http.end(); //Free the resources
    Serial.println("Trace just after http.end()");
  }
  delay(1000);
}

Output from Serial monitor with debug traces enabled:

15:36:22.978 -> Waiting for Wifi
15:36:22.978 -> Wifi connected
15:36:23.934 -> [V][HTTPClient.cpp:235] beginInternal(): url: http://192.168.0.105:485/esp32.html
15:36:24.034 -> [D][HTTPClient.cpp:276] beginInternal(): host: 192.168.0.105 port: 485 url: /esp32.html
15:36:24.135 -> [D][HTTPClient.cpp:1025] connect():  connected to 192.168.0.105:485
15:36:24.382 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'HTTP/1.1 200 OK'
15:36:24.471 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Content-Length: 148'
15:36:24.552 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Content-Type: text/html'
15:36:24.633 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Server: rpi'
15:36:24.715 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Date: Thu, 23 Jan 2020 14:36:23 GMT'
15:36:24.796 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Connection: close'
15:36:24.877 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: ''
15:36:24.959 -> [D][HTTPClient.cpp:1158] handleHeaderResponse(): code: 200
15:36:25.000 -> [D][HTTPClient.cpp:1161] handleHeaderResponse(): size: 148
15:36:25.081 -> [D][HTTPClient.cpp:1295] writeToStreamDataBlock(): connection closed or file end (written: 148).
15:36:25.163 -> [D][HTTPClient.cpp:370] disconnect(): tcp stop
15:36:25.246 -> 
15:36:25.246 -> Payload: <!doctype html><html lang="en"><head><meta charset="utf-8"><title>Esp32</title></head><body><p>2020-01-23 15:36:23;23.13;4.63;2.3;</p></body></html>
15:36:25.399 -> Trace just before http.end()
15:36:25.399 -> [D][HTTPClient.cpp:383] disconnect(): tcp is closed
15:36:25.500 -> 
15:36:26.350 -> [V][HTTPClient.cpp:235] beginInternal(): url: http://192.168.0.105:485/esp32.html
15:36:26.450 -> [D][HTTPClient.cpp:276] beginInternal(): host: 192.168.0.105 port: 485 url: /esp32.html
15:36:26.504 -> [D][HTTPClient.cpp:1025] connect():  connected to 192.168.0.105:485
15:36:26.851 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'HTTP/1.1 200 OK'
15:36:26.952 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Content-Length: 148'
15:36:27.005 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Content-Type: text/html'
15:36:27.106 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Server: rpi'
15:36:27.152 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Date: Thu, 23 Jan 2020 14:36:26 GMT'
15:36:27.253 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Connection: close'
15:36:27.353 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: ''
15:36:27.406 -> [D][HTTPClient.cpp:1158] handleHeaderResponse(): code: 200
15:36:27.453 -> [D][HTTPClient.cpp:1161] handleHeaderResponse(): size: 148
15:36:27.507 -> [D][HTTPClient.cpp:1295] writeToStreamDataBlock(): connection closed or file end (written: 148).
15:36:27.607 -> [D][HTTPClient.cpp:370] disconnect(): tcp stop
15:36:27.707 -> 
15:36:27.707 -> Payload: <!doctype html><html lang="en"><head><meta charset="utf-8"><title>Esp32</title></head><body><p>2020-01-23 15:36:25;23.13;4.63;2.3;</p></body></html>
15:36:27.839 -> Trace just before http.end()
15:36:27.886 -> Guru Meditation Error: Core  1 panic'ed (LoadProhibited). Exception was unhandled.
15:36:27.970 -> Core 1 register dump:
15:36:27.970 -> PC      : 0x4015d4d8  PS      : 0x00060430  A0      : 0x800d36db  A1      : 0x3ffb1e80  
15:36:28.109 -> A2      : 0x3ffb1f10  A3      : 0x00000002  A4      : 0x0000001c  A5      : 0x0000ff00  
15:36:28.155 -> A6      : 0x00ff0000  A7      : 0xff000000  A8      : 0x800d6591  A9      : 0x3ffb1e60  
15:36:28.256 -> A10     : 0x3ffbda34  A11     : 0x3f40240a  A12     : 0x00000002  A13     : 0x0000ff00  
15:36:28.356 -> A14     : 0x00ff0000  A15     : 0xff000000  SAR     : 0x00000004  EXCCAUSE: 0x0000001c  
15:36:28.456 -> EXCVADDR: 0x00000012  LBEG    : 0x400014fd  LEND    : 0x4000150d  LCOUNT  : 0xffffffff  
15:36:28.557 -> 
15:36:28.557 -> Backtrace: 0x4015d4d8:0x3ffb1e80 0x400d36d8:0x3ffb1ea0 0x400d37a9:0x3ffb1ec0 0x400d1ba6:0x3ffb1ee0 0x400d7775:0x3ffb1fb0 0x40088b9d:0x3ffb1fd0
15:36:28.710 -> 
15:36:28.710 -> Rebooting...
15:36:28.710 -> 	1⸮⸮⸮��⸮V�ŌHT⸮⸮Xl@�⸮[D][WiFiGeneric.cpp:337] _eventCallback(): Event: 0 - WIFI_READY
15:36:33.174 -> [D][WiFiGeneric.cpp:337] _eventCallback(): Event: 2 - STA_START
15:36:33.328 -> [D][WiFiGeneric.cpp:337] _eventCallback(): Event: 4 - STA_CONNECTED
15:36:33.629 -> [D][WiFiGeneric.cpp:337] _eventCallback(): Event: 7 - STA_GOT_IP
15:36:33.676 -> [D][WiFiGeneric.cpp:381] _eventCallback(): STA IP: 192.168.0.112, MASK: 255.255.255.0, GW: 192.168.0.1
15:36:34.130 -> Waiting for Wifi
15:36:34.130 -> Wifi connected
15:36:35.132 -> [V][HTTPClient.cpp:235] beginInternal(): url: http://192.168.0.105:485/esp32.html
15:36:35.232 -> [D][HTTPClient.cpp:276] beginInternal(): host: 192.168.0.105 port: 485 url: /esp32.html
15:36:37.038 -> [D][HTTPClient.cpp:1025] connect():  connected to 192.168.0.105:485
15:36:37.393 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'HTTP/1.1 200 OK'
15:36:37.493 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Content-Length: 148'
15:36:37.540 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Content-Type: text/html'
15:36:37.641 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Server: rpi'
15:36:37.694 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Date: Thu, 23 Jan 2020 14:36:36 GMT'
15:36:37.794 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: 'Connection: close'
15:36:37.895 -> [V][HTTPClient.cpp:1123] handleHeaderResponse(): RX: ''
15:36:37.941 -> [D][HTTPClient.cpp:1158] handleHeaderResponse(): code: 200
15:36:37.995 -> [D][HTTPClient.cpp:1161] handleHeaderResponse(): size: 148
15:36:38.095 -> [D][HTTPClient.cpp:1295] writeToStreamDataBlock(): connection closed or file end (written: 148).
15:36:38.164 -> [D][HTTPClient.cpp:370] disconnect(): tcp stop
15:36:38.233 -> 
15:36:38.233 -> Payload: <!doctype html><html lang="en"><head><meta charset="utf-8"><title>Esp32</title></head><body><p>2020-01-23 15:36:36;23.13;4.63;2.3;</p></body></html>
15:36:38.370 -> Trace just before http.end()
15:36:38.404 -> Guru Meditation Error: Core  1 panic'ed (IllegalInstruction). Exception was unhandled.
15:36:38.496 -> Core 1 register dump:
15:36:38.543 -> PC      : 0x54000000  PS      : 0x00060430  A0      : 0x800d36db  A1      : 0x3ffb1e80  
15:36:38.644 -> A2      : 0x3ffb1f10  A3      : 0x54000000  A4      : 0x0000001c  A5      : 0x0000ff00  
15:36:38.744 -> A6      : 0x00ff0000  A7      : 0xff000000  A8      : 0x8015d4de  A9      : 0x3ffb1e60  
15:36:38.797 -> A10     : 0x3ffbdaf0  A11     : 0x3f40240a  A12     : 0x00000002  A13     : 0x0000ff00  
15:36:38.898 -> A14     : 0x00ff0000  A15     : 0xff000000  SAR     : 0x00000004  EXCCAUSE: 0x00000000  
15:36:38.998 -> EXCVADDR: 0x00000000  LBEG    : 0x400014fd  LEND    : 0x4000150d  LCOUNT  : 0xffffffff  
15:36:39.098 -> 
15:36:39.098 -> Backtrace: 0x54000000:0x3ffb1e80 0x400d36d8:0x3ffb1ea0 0x400d37a9:0x3ffb1ec0 0x400d1ba6:0x3ffb1ee0 0x400d7775:0x3ffb1fb0 0x40088b9d:0x3ffb1fd0
15:36:39.246 -> 
15:36:39.246 -> Rebooting...
15:36:39.299 ->

Output from ESP Exception decoder:

Decoding stack results
0x4015d4d8: HTTPClient::connected() at C:\Users\kfj41\AppData\Local\Arduino15\packages\esp32\hardware\esp32\1.0.4\libraries\HTTPClient\src\HTTPClient.cpp line 395
0x400d36d8: HTTPClient::disconnect(bool) at C:\Users\kfj41\AppData\Local\Arduino15\packages\esp32\hardware\esp32\1.0.4\libraries\HTTPClient\src\HTTPClient.cpp line 359
0x400d37a9: HTTPClient::end() at C:\Users\kfj41\AppData\Local\Arduino15\packages\esp32\hardware\esp32\1.0.4\libraries\HTTPClient\src\HTTPClient.cpp line 347
0x400d1ba6: loop() at C:\Users\kfj41\Documents\Arduino\Display SPI test\TFT_eSPI_WiFi_Http_req_5 without display\TFT_eSPI_WiFi_Http_req_4/TFT_eSPI_WiFi_Http_req_4.ino line 60
0x400d7775: loopTask(void*) at C:\Users\kfj41\AppData\Local\Arduino15\packages\esp32\hardware\esp32\1.0.4\cores\esp32\main.cpp line 19
0x40088b9d: vPortTaskWrapper at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/freertos/port.c line 143

The text was updated successfully, but these errors were encountered:

lbernstone · 2020-01-23T20:14:49Z

If you change the http.end to:
if (http.connected()) http.end();
do you get an exception?

KenthJ · 2020-01-24T15:37:30Z

if (http.connected()) http.end();

Ibernstone, I tried your suggestion, but unfortunately it didn't solve the problem.

Adding more traces shown that the ESP32 often crashes before the http.end() is called at all

Could the error be related to that I am using a fixed IP address instead of a domain name, and no DNS lookup is done?

KenthJ · 2020-02-01T04:44:32Z

Anybody able to help here?

I would really appriciate some help with this.

Thanks in advance

liebman · 2020-02-01T14:19:42Z

I can't reproduce this (with the URL changed to https://jigsaw.w3.org/HTTP/300/Overview.html)
Can you share how the server is configured so I can try to set that up here? (its a Raspberry Pi?)

KenthJ · 2020-02-02T16:54:40Z

Liebman, yes it is a Raspberry Pi running Windows 10 IoT

I inserted details below, do you need anything else?

Header from Fiddler
HTTP/1.1 200 Connection Established Content-Length: 148 Content-Type: text/html Server: rpi Date: Sun, 02 Feb 2020 15:54:59 GMT Connection: close

Raw content from Fiddler:
HTTP/1.1 200 Connection Established
Content-Length: 148
Content-Type: text/html
Server: rpi
Date: Sun, 02 Feb 2020 15:54:59 GMT
Connection: close
<!doctype html><title>Esp32</title>

2020-02-02 16:54:59;23.88;3.56;2.3;

liebman · 2020-02-02T17:11:39Z

OK, I won't be loading Windows IoT on my Pi. I'll set the web server on it up with something that looks similar-ish.

KenthJ · 2020-02-02T18:13:06Z

Great, I really appreciate that.

The raw content in my original post doesn't look correctly, since the html part isn't shown as I have written it, but I guess that is not so important, since I have validated the html content

liebman · 2020-02-02T19:14:17Z

I've been unable to duplicate the crash with current git version and apache2 configured on a Pi with: (/etc/apache2/sites-enabled/001-esp32.conf )

Listen 485
<VirtualHost *:485>
	ServerAdmin webmaster@localhost
	DocumentRoot /var/www/html
	ErrorLog ${APACHE_LOG_DIR}/error.log
	CustomLog ${APACHE_LOG_DIR}/access.log combined
</VirtualHost>

# vim: syntax=apache ts=4 sw=4 sts=4 sr noet

and the html file: (/var/www/html/esp32.html )

<!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd">
<html lang="en">
  <head>
    <meta http-equiv="content-type" content="text/html; charset=utf-8">
    <title>esp32 test</title>
  </head>
  <body>
    This is a test.	
  </body>
</html>

KenthJensen · 2020-02-03T05:44:09Z

Liebman

Thank you so much for your support, I really appreciate it.

I have an extra Raspberry PI laying around, so I will try your example above on that one, it looks fairly simple.

Have you run it on Rasbbian on your Raspberry PI, and can I just install it via NOOBS?

liebman · 2020-02-03T13:22:04Z

I used Raspbian.

KenthJ · 2020-02-05T18:24:42Z

After a lot of trial and error I managed to get the Apache webserver up and running on Raspbian, and I agree, things worked fine using this webserver, the ESP32 didn't crash here.

I noticed that my old server used the following in the http header:
Connection: close

But the Apache webserver used:
Keep-Alive: timeout=5, max=100
Connection: Keep-Alive

I tried using the same in the header from my original webserver, and voila, now the ESP32 didn't crash anymore.

This is a workaround I easily can live with permanently, but I guess it's something the httpCLient should be robust for, and not crash.

But thank you very much Liebman, so nice to get the problem solved.

liebman · 2020-02-05T19:06:05Z

I'll change the apache configuration I used to disable keep-alive and see if I can reproduce the issue.

liebman · 2020-02-06T00:07:11Z

Even with keep-alive disabled in apache I can't reproduce the crashes.

Zenock · 2020-02-16T03:41:04Z

Same issue. I'm not sure how to change the header from my server. :-( Mostly on http.end() but occasionally elsewhere.

Guru Meditation Error: Core 1 panic'ed (LoadProhibited). Exception was unhandled.
Core 1 register dump:
PC : 0x4015c69c PS : 0x00060630 A0 : 0x800d329a A1 : 0x3ffb1ef0
A2 : 0x3ffc106c A3 : 0x00000000 A4 : 0x00000004 A5 : 0x0000ff00
A6 : 0x00ff0000 A7 : 0xff000000 A8 : 0x800d50c1 A9 : 0x3ffb1ed0
A10 : 0x3ffba860 A11 : 0x3f4015f2 A12 : 0x00000002 A13 : 0x0000ff00
A14 : 0x00ff0000 A15 : 0xff000000 SAR : 0x0000001b EXCCAUSE: 0x0000001c
EXCVADDR: 0x00000010 LBEG : 0x400014fd LEND : 0x4000150d LCOUNT : 0xffffffff

Backtrace: 0x4015c69c:0x3ffb1ef0 0x400d3297:0x3ffb1f10 0x400d3309:0x3ffb1f30 0x400d1a32:0x3ffb1f50 0x400d1b5a:0x3ffb1f90 0x400d62bd:0x3ffb1fb0 0x40088b9d:0x3ffb1fd0

Rebooting...

I'm using a hosted web server. Not sure I can change the header. Wouldn't know how if I could.

antonmeyer · 2020-03-07T18:39:56Z

Looks like I have a similar Problem. but in my case it triggers InstrFetchProhibited.
the backtrace initial pointed to the display u8x8. but esp32 crashes also without display.

mst-at · 2020-04-04T18:37:09Z

Hello,
I'm also experiencing similar issues.
Board: DOIT ESP32 DEVKIT V1
IDE name: Arduino IDE version 1.8.12
Flash Frequency: 80Mhz
Upload Speed: 921600
Computer OS: Ubuntu 18.04.4 LTS

My application is to POST a json file to a webpage. Everything works fine using arduino-eps32 v1.0.2 but when using v1.0.3 and 1.0.4 it fails with:

Guru Meditation Error: Core  1 panic'ed (LoadProhibited). Exception was unhandled.
Core 1 register dump:
PC      : 0x400d4bba  PS      : 0x00060430  A0      : 0x800d1cc0  A1      : 0x3ffb1e20  
A2      : 0x3ffb1f10  A3      : 0x00000000  A4      : 0x0000000a  A5      : 0x3ffc1670  
A6      : 0x3f40327e  A7      : 0xffffffff  A8      : 0x800d695c  A9      : 0x3ffb1e00  
A10     : 0x3ffcb6ac  A11     : 0x3ffbf448  A12     : 0x0000000a  A13     : 0x3f40239f  
A14     : 0x00000000  A15     : 0x0000002e  SAR     : 0x00000004  EXCCAUSE: 0x0000001c  
EXCVADDR: 0x00000038  LBEG    : 0x400014fd  LEND    : 0x4000150d  LCOUNT  : 0xffffffff  

Backtrace: 0x400d4bba:0x3ffb1e20 0x400d1cbd:0x3ffb1e40 0x400d7739:0x3ffb1fb0 0x40088b9d:0x3ffb1fd0

Sometimes it works without problem on first run but fails in the second loop (it also seems to depend on completely unrelated code executed after http.end()).

Minimum example of the code showing the issue is:

#include "WiFi.h"
#include <HTTPClient.h>
#include "base64.h"

// WIFI settings
const char* ssid = "MySSID";
const char* password = "MyPassword";

// website authentication
String authUsername = "MyUser";
String authPassword = "MyPassword";


void connectWiFi(){
  // Connect to Wi-Fi
  WiFi.begin(ssid, password);

  while (WiFi.status() != WL_CONNECTED) {
    Serial.println("Connecting to WiFi..");
    delay(1000);
  }
}

void setup() {
  // put your setup code here, to run once:
  // Serial port for debugging purposes
  Serial.begin(115200);

  // Connect to Wi-Fi
  connectWiFi();
}

void loop() {
  
  if(WiFi.status()== WL_CONNECTED){   //Check WiFi connection status
    Serial.println("++++++++++++++++++++++ Starting round ++++++++++++++++++++++");
    char buffer[100] = "{\"location\":\"esp32\",\"temperature\":42.42,\"humidity\":42.42}";
    Serial.println(buffer);
   
   // transfer
   HTTPClient http; 

   http.begin("http://sub.domain.com/writeData.php");
   http.addHeader("Content-Type", "application/json");
   String auth = base64::encode(authUsername + ":" + authPassword);
   http.addHeader("Authorization", "Basic " + auth);
 
   int httpResponseCode = http.POST(buffer);
   String response = http.getString();
   delay(5000);
   Serial.println(httpResponseCode);
   Serial.println(response);
   Serial.println("---------------- Done with round ---------------------");
   http.end(); 
   delay(5000);
   Serial.println(httpResponseCode);
   Serial.println("----------- Really done with round -----------------");
   
   if ( httpResponseCode == 200 ){
       Serial.println("Success!");
       delay(5000);
   }
  }
  Serial.println("Sleeping...");
  delay(5000);
  Serial.println("############# Totally done with round ############");
}

The response from the webserver to the POST request is:
Header:

HTTP/1.1 200 OK
Date: Sat, 04 Apr 2020 18:27:54 GMT
Server: Apache
Connection: close
Transfer-Encoding: chunked
Content-Type: text/html; charset=UTF-8

Message:

New records created successfully
writeData.php

I would appreciate any hint on how this issue could be solved, I already spent hours on it with no outcome.
Best regards,
Martin

ThomasWaldmann · 2020-05-20T12:13:01Z

7d78247#r39308827 maybe related?

update: that was changed again afterwards: f4acac4#diff-39b6d5e36cff20acc96b42ef19ad4deb

recent fixes, needs checking: esp8266/Arduino#6476

if have the impression that the esp8266 HTTPClient is getting fixes, but the esp32 incarnation misses some. @Jeroen88 could that be the root cause of this issue?

stale · 2020-08-13T12:58:18Z

[STALE_SET] This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 14 days if no further activity occurs. Thank you for your contributions.

ThomasWaldmann · 2020-08-13T18:24:53Z

Maybe usage of stalebot should be reconsidered. It is pointless and even harmful to close unfixed bugs (or like in this case, make people making pointless posts just to avoid closure).

stale · 2020-08-13T18:24:56Z

[STALE_CLR] This issue has been removed from the stale queue. Please ensure activity to keep it openin the future.

wrybread · 2020-10-06T20:50:02Z

I get the same crash whenever I connect to a webserver that sends the header "connection: close". The crash happens on the second iteration of the loop (the second time connecting). It doesn't happen when I connect to a webserver that doesn't send that header.

Does anyone have any ideas?

Unfortunately I don't have control over the webserver, it's the webserver built into a weather station.

Stripped down code:


// Import required libraries for wifi
#ifdef ESP32
  #include <WiFi.h>
  #include <WiFiMulti.h>
#else
  # these are untested, I've only tested with an ESP32
  #include <Arduino.h>
  #include <ESP8266WiFi.h>
  #include <Hash.h>
  #include <ESPAsyncTCP.h>
#endif

#include <HTTPClient.h>

// init wifimulti (lets us specify multiple ssid's)
WiFiMulti wifiMulti;

void setup(){
  Serial.begin(115200);
  delay(10);
  Serial.println("Starting up!");

  // specify SSIDs (these must be 2.4ghz networks)
  wifiMulti.addAP("put ssid here", "put password here");  

  // (Note that must run wifiMulti.run() here or it will reset in a loop...)
  Serial.println("Connecting Wifi...");
  if(wifiMulti.run() == WL_CONNECTED) {
      Serial.println("");
      Serial.print("WiFi connected! ");
      Serial.print( WiFi.SSID().c_str() );
      Serial.print(" ");
      Serial.print("IP address: ");
      Serial.println(WiFi.localIP());
  }
}


void loop(){ 

  delay(1000);

  if(wifiMulti.run() == WL_CONNECTED) {

    HTTPClient http;  

    // crashes! (because sends header "connection:close")
    String airlinkURL = "http://10.10.10.51/v1/current_conditions";      

    // works! (because doesn't send header "connection:close") (it sends "Connection: Keep-Alive")
    //String airlinkURL = "http://sinkingsensation.com/aqi/get_json.php";      

    
    Serial.print("Getting data from Airlink: ");
    Serial.println(airlinkURL);
    http.begin(airlinkURL.c_str());
    int httpResponseCode = http.GET();
    
    if (httpResponseCode>0) {
      Serial.print("HTTP Response code: ");
      Serial.println(httpResponseCode);
      
      String payload = http.getString();
  
      // causes crash?
      //Serial.println(payload);
      
    }
    else {
      Serial.print("Error connecting to the AirLink: ");
      Serial.println(httpResponseCode);
    }
  
    http.end();

    delay(5000);

  } // end if connected

}

wrybread · 2020-10-06T22:11:50Z

Aha, I found a workaround. It's ugly, but it seems to work.

I had to modify HTTPClient.cpp, which on my Windows system is in C:\Users\USERNAME\AppData\Local\Arduino15\packages\esp32\hardware\esp32\1.0.4\libraries\HTTPClient\src.

Comment out these lines, or change the conditional or comment out "_canReuse = false;":

                if(_canReuse && headerName.equalsIgnoreCase("Connection")) {
                    if(headerValue.indexOf("close") >= 0 && headerValue.indexOf("keep-alive") < 0) {
                        _canReuse = false;
                    }
                }

I'm glad to test any changes or alternative versions with this webserver, if anyone needs just let me know.

dev-techshlok · 2020-10-29T07:08:56Z

Thank you @wrybread. Your method worked for me.

wimjanse · 2020-12-15T11:16:35Z

Thank you @wrybread. I had problems with crashing http.end(), but your method solved the issue

apreb · 2020-12-26T23:15:44Z

Hi, was having the same exception issues and managed to solve it by using a different begin function:

const char *_url = "http://192.168.1.1/getstuff";
WiFiClient client;
HTTPClient http;
http.begin(client,_url);
    
if( http.GET() )
{
  String payload = http.getString();
  Serial.println(payload);
  payload = String();
} 
http.end();

ThomasWaldmann · 2020-12-27T14:59:58Z

@apreb that rather looks like some testing code than a modified begin function. Copy&Paste gone wrong?

VojtechBartoska · 2022-03-30T15:52:20Z

Hello, adding this issue to Roadmap so we will investigate this more.

me-no-dev · 2022-05-13T08:17:57Z

Can someone please re-test this against the latest version (2.0.3 currently)

podaen · 2022-05-17T11:16:46Z

I have tested the http.end() and didn't crash. Here is the log.

[ 30001][D][HTTPClient.cpp:388] disconnect(): still data in buffer (114), clean up.
[ 30001][E][WiFiClient.cpp:517] flush(): fail on fd 48, errno: 11, "No more processes"
[ 30006][D][HTTPClient.cpp:395] disconnect(): tcp stop

Is this meant to end too WL_CONNECTED? Because I need the reconnect the WiFi.

PilnyTomas · 2022-08-09T09:23:32Z

Hi @KenthJ, I just tested it on 2.0.4 and it seems to be ok.
I tested it for Google and local HomeAsistant setup page - both continued operation without crashing.
Can you please confirm if it is solved for you? If so, please close the issue.

PilnyTomas · 2022-08-25T10:25:46Z

Closing as expired

ThomasWaldmann · 2022-08-25T15:38:44Z

Can somebody add a link to the bugfix changeset please?

mpearon · 2024-03-27T02:05:35Z

Just to add to the noise here, I was having this issue and spinning up a new instance of HTTPClient did the trick for me.

It's messy and won't work for 100% of cases, but for simple GET stuff, it got me up and running without a crash on the 2nd GET.
I am using framework-arduinoespressif32 @ 3.20014.231204 (2.0.14) and HTTPClient @ 2.0.0.

I went from this:

#include <WebSerial.h>
#include <config.h>
#include <HTTPClient.h>
#include <diagControl.h>
#include <regex>
#include <iostream>

HTTPClient http;

std::string getMetar( std::string icaoId ){
	std::string apiBase = "https://aviationweather.gov/api/data/metar?format=raw&taf=false&ids=";
	std::string url = apiBase += icaoId;
	http.begin( url.c_str() );
	int httpResponseCode = http.GET();
	if( httpResponseCode > 0 ){
		if( httpResponseCode == HTTP_CODE_OK ){
			String payload = (http.getString());
			return payload.c_str();
		}
	}
	http.end();
}

to this:

#include <WebSerial.h>
#include <config.h>
#include <HTTPClient.h>
#include <diagControl.h>
#include <regex>
#include <iostream>

std::string getMetar( std::string icaoId ){
	std::string apiBase = "https://aviationweather.gov/api/data/metar?format=raw&taf=false&ids=";
	std::string url = apiBase += icaoId;
	HTTPClient http;
	http.begin( url.c_str() );
	int httpResponseCode = http.GET();
	if( httpResponseCode > 0 ){
		if( httpResponseCode == HTTP_CODE_OK ){
			String payload = (http.getString());
			return payload.c_str();
		}
	}
	http.end();
}

hemangjoshi37a · 2024-06-12T14:33:21Z

has this been solved yet ?

awyork mentioned this issue Apr 25, 2020

ESP32 HTTPClient does not like to talk to ESP8266WebServer #3941

Closed

ThomasWaldmann mentioned this issue May 20, 2020

Core Panic (InstrFetchProhibited) occasionally causes reboot ecocurious2/MultiGeiger#314

Closed

stale bot added the Status: Stale Issue is stale stage (outdated/stuck) label Aug 13, 2020

stale bot removed the Status: Stale Issue is stale stage (outdated/stuck) label Aug 13, 2020

VojtechBartoska removed the Status: In Progress ⚠️ Issue is in progress label Mar 30, 2022

VojtechBartoska added this to Arduino ESP32 Core Project Roadmap Mar 30, 2022

VojtechBartoska added Status: To be implemented Selected for Development Status: Awaiting triage Issue is waiting for triage labels Mar 30, 2022

VojtechBartoska moved this to Todo in Arduino ESP32 Core Project Roadmap Mar 30, 2022

igrr added Type: Bug 🐛 All bugs Status: Test needed Issue needs testing and removed Status: To be implemented Selected for Development Status: Awaiting triage Issue is waiting for triage labels Apr 5, 2022

VojtechBartoska assigned PilnyTomas Aug 8, 2022

VojtechBartoska moved this from Todo to Under investigation in Arduino ESP32 Core Project Roadmap Aug 8, 2022

PilnyTomas added the Resolution: Awaiting response Waiting for response of author label Aug 9, 2022

PilnyTomas closed this as completed Aug 25, 2022

Repository owner moved this from Under investigation to Done in Arduino ESP32 Core Project Roadmap Aug 25, 2022

VojtechBartoska added Resolution: Expired More info wasn't provided and removed Status: Test needed Issue needs testing Resolution: Awaiting response Waiting for response of author labels Aug 25, 2022

garageeks mentioned this issue Aug 28, 2022

ESP32 BLE/WiFi throws an error [E][WiFiClient.cpp:395] write(): fail on fd 54, errno: 11, "No more processes" - still not resolved #6129

Closed

1 task

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HttpClient crashes after HTTP request #3659

HttpClient crashes after HTTP request #3659

KenthJ commented Jan 23, 2020 •

edited

Loading

lbernstone commented Jan 23, 2020

KenthJ commented Jan 24, 2020

KenthJ commented Feb 1, 2020

liebman commented Feb 1, 2020

KenthJ commented Feb 2, 2020 •

edited

Loading

liebman commented Feb 2, 2020

KenthJ commented Feb 2, 2020 •

edited

Loading

liebman commented Feb 2, 2020

KenthJensen commented Feb 3, 2020

liebman commented Feb 3, 2020

KenthJ commented Feb 5, 2020

liebman commented Feb 5, 2020

liebman commented Feb 6, 2020

Zenock commented Feb 16, 2020

antonmeyer commented Mar 7, 2020

mst-at commented Apr 4, 2020

ThomasWaldmann commented May 20, 2020 •

edited

Loading

stale bot commented Aug 13, 2020

ThomasWaldmann commented Aug 13, 2020 •

edited

Loading

stale bot commented Aug 13, 2020

wrybread commented Oct 6, 2020

wrybread commented Oct 6, 2020 •

edited

Loading

dev-techshlok commented Oct 29, 2020

wimjanse commented Dec 15, 2020

apreb commented Dec 26, 2020

ThomasWaldmann commented Dec 27, 2020

VojtechBartoska commented Mar 30, 2022

me-no-dev commented May 13, 2022

podaen commented May 17, 2022

PilnyTomas commented Aug 9, 2022

PilnyTomas commented Aug 25, 2022

ThomasWaldmann commented Aug 25, 2022

mpearon commented Mar 27, 2024

hemangjoshi37a commented Jun 12, 2024

HttpClient crashes after HTTP request #3659

HttpClient crashes after HTTP request #3659

Comments

KenthJ commented Jan 23, 2020 • edited Loading

lbernstone commented Jan 23, 2020

KenthJ commented Jan 24, 2020

KenthJ commented Feb 1, 2020

liebman commented Feb 1, 2020

KenthJ commented Feb 2, 2020 • edited Loading

liebman commented Feb 2, 2020

KenthJ commented Feb 2, 2020 • edited Loading

liebman commented Feb 2, 2020

KenthJensen commented Feb 3, 2020

liebman commented Feb 3, 2020

KenthJ commented Feb 5, 2020

liebman commented Feb 5, 2020

liebman commented Feb 6, 2020

Zenock commented Feb 16, 2020

antonmeyer commented Mar 7, 2020

mst-at commented Apr 4, 2020

ThomasWaldmann commented May 20, 2020 • edited Loading

stale bot commented Aug 13, 2020

ThomasWaldmann commented Aug 13, 2020 • edited Loading

stale bot commented Aug 13, 2020

wrybread commented Oct 6, 2020

wrybread commented Oct 6, 2020 • edited Loading

dev-techshlok commented Oct 29, 2020

wimjanse commented Dec 15, 2020

apreb commented Dec 26, 2020

ThomasWaldmann commented Dec 27, 2020

VojtechBartoska commented Mar 30, 2022

me-no-dev commented May 13, 2022

podaen commented May 17, 2022

PilnyTomas commented Aug 9, 2022

PilnyTomas commented Aug 25, 2022

ThomasWaldmann commented Aug 25, 2022

mpearon commented Mar 27, 2024

hemangjoshi37a commented Jun 12, 2024

KenthJ commented Jan 23, 2020 •

edited

Loading

KenthJ commented Feb 2, 2020 •

edited

Loading

KenthJ commented Feb 2, 2020 •

edited

Loading

ThomasWaldmann commented May 20, 2020 •

edited

Loading

ThomasWaldmann commented Aug 13, 2020 •

edited

Loading

wrybread commented Oct 6, 2020 •

edited

Loading