[sendtohttp] thingspeak only reply event #4856

chromoxdor · 2023-10-25T11:09:50Z

I added an event for a specific thingspeak request:

Get the value of a single field:
- Example command:
  SendToHTTP,api.thingspeak.com,80,/channels/1637928/fields/5/last.csv
- Example of the resulting event:
  "EVENT: ThingspeakReply=1637928,5,24.2"
  
  | channel number = %eventvalue1%
  | field number = %eventvalue2%
  | value = %eventvalue3%
Get the values of all fields:
- Example command:
  SendToHTTP,api.thingspeak.com,80,/channels/1637928/feeds/last.csv
- Example of the resulting event:
  "EVENT:ThingspeakReply=1637928,5929,353,42.0,177,19.1,995.6,,"
  
  | channel number = %eventvalue1%
  | values = %eventvalue2% to %eventvalue9%

chromoxdor · 2023-10-25T11:19:32Z

Rules Example:

On Rules#Timer=1 Do
  SendToHTTP, api.thingspeak.com,80,/channels/143789/feeds/last.csv
Endon

On ThingspeakReply Do
   LogEntry,'%eventvalue6%°C in Berlin'
   LogEntry,'%eventvalue7%°C in Paris'
  Endif
Endon

Output:

1050425: EVENT: http#api.thingspeak.com=200
1050433: EVENT: ThingspeakReply=143789,11.64,-0.05,5.46,14.39,2.2,6.94,-13.48,11.05
1050443: ACT : LogEntry,'2.2°C in Berlin'
1050445: 2.2°C in Berlin
1050473: ACT : LogEntry,'6.94°C in Paris'
1050476: 6.94°C in Paris

chromoxdor · 2023-10-25T11:37:05Z

I made this optional but i am not sure if i did it right..

src/src/Helpers/Networking.cpp

chromoxdor · 2023-10-25T20:11:17Z

Should i add this to the documentation as an annotation in the SendToHTTP section?

tonhuisman · 2023-10-25T20:15:03Z

Should i add this to the documentation as an annotation in the SendToHTTP section?

Yes, as it is on by default for regular builds (without LIMIT_BUILD_SIZE set).

chromoxdor · 2023-10-25T20:27:11Z

Yes, as it is on by default for regular builds (without LIMIT_BUILD_SIZE set).

I will do it tomorrow.. my battery is empty

chromoxdor · 2023-10-26T14:22:51Z

@TD-er & @tonhuisman i tried another approach where all the fields gets parsed from csv

the command: sendToHTTP,api.thingspeak.com,80,/channels/1637928/feeds/last.csv

the code:

if (httpCode == 200 && equals(host, F("api.thingspeak.com")) && uri.endsWith(F("/last.csv"))) {
        String result = http.getString();                                                                
        //created_at,entry_id,field1,field2,field3,field4,field5,field6,field7,field8^2023-10-26T16:14:17+02:00,921,5929,353,42.0,177,19.1,995.6,,                                                             
        result = result.substring(result.lastIndexOf(':'), result.length());                                                                                            
        //00,921,5929,353,42.0,177,19.1,995.6,,
        result = result.substring(result.indexOf(',', result.indexOf(',') + 1 )+1, result.length()-1);  
        //5929,353,42.0,177,19.1,995.6,,
        eventQueue.add(strformat(F("ThingspeakReply=%s,%s"),                                            
                         parseStringKeepCase(uri, 2, '/').c_str(),
                         result.c_str()));
      }

the output:
EVENT: ThingspeakReply=1637928,5929,353,42.0,177,19.1,995.6,,

Would this also be an option or are there good reasons not to do it?

tonhuisman · 2023-10-26T19:16:42Z

Hmm, it looks like pygit2 is broken... 😞

chromoxdor · 2023-10-26T19:27:44Z

Hmm, it looks like pygit2 is broken... 😞

Is there something i can do?

TD-er · 2023-10-26T20:13:02Z

Hmm, it looks like pygit2 is broken... 😞

Is there something i can do?

Nope, those build issues are often a network issue on the build environment.
I just restarted the last failed build, so it will now probably run just fine.

TD-er · 2023-10-26T20:15:17Z

if (posTimestamp >= 0) {

do we really need this? isn´t it kind of a redundancy to if ... uri.endsWith(F("/last.csv"))) since it is a given format which always contains the time?

Nope, server response may not be complete, or something else may be wrong.
So if the most basic check isn't working (presence of a single :), then I rather not see any event be generated.

chromoxdor · 2023-10-27T08:40:49Z

Dear @TD-er,
can I smuggle this in?

Command:
sendtohttp,api.openweathermap.org,80,/data/2.5/weather?id=2950159&units=metric&appid=XXXXXX

Event:
EVENT: OpenweatherReply=2950159,9.86,8.03,8.94,11.31,982,93,3.58,80,mist

(EVENT: OpenweatherReply=<id>,<temp>,<feels_like>,<temp_min>,<temp_max>,<pressure>,<humidity>,<windspeed_m/s>,<wind_direction>,<condition>)

Response:
{"coord":{"lon":13.4105,"lat":52.5244},"weather":[{"id":701,"main":"Mist","description":"mist","icon":"50d"}],"base":"stations","main":{"temp":9.86,"feels_like":8.27,"temp_min":8.89,"temp_max":11.76,"pressure":982,"humidity":94},"visibility":4100,"wind":{"speed":3.13,"deg":83,"gust":4.47},"clouds":{"all":100},"dt":1698393307,"sys":{"type":2,"id":2011538,"country":"DE","sunrise":1698385948,"sunset":1698421669},"timezone":7200,"id":2950159,"name":"Berlin","cod":200}

Code:

if (httpCode == 200 && equals(host, F("api.openweathermap.org"))) {
          String result = http.getString(); 
          result.replace('[', '_'); //get rid of these otherwise parsing won´t work
          result.replace(']', '_');
          String wVals;
          String res;
          int Num[10]{25, 8, 9, 10, 11, 12, 13, 15, 16, 5};  

          for (int i : Num) {
            res = parseStringKeepCase(result, i);
            res = res.substring(res.lastIndexOf(':')+1);
            if (res.endsWith("}")) {res = res.substring(0,res.lastIndexOf('}'));} //get rid of
            if (i == 5) {res = res.substring(1);}                       //unwanted characters
            wVals += res;
            if (i != 5) {
              wVals += ",";
            }
          }

          eventQueue.addMove(strformat(F("OpenweatherReply=%s"),                                            
            wVals.c_str()));
        }

I would make this a custom build feauture only...

chromoxdor · 2023-10-27T09:13:23Z

The funny thing is, i was just searching in the forum a bit if anybody had a requests regarding this topic.
To my surprise i found "somebody".
https://www.letscontrolit.com/forum/viewtopic.php?t=8500

Who would have guessed, that 2,5 years later i am the one helping me from the past...

tonhuisman · 2023-10-27T10:52:04Z

Response:

That response should better be parsed as the Json it is, not try to pick out just some values. Most likely the content of that Json will change somewhere in the future, breaking your fixed indexes 🤔
Be aware that parsing Json is a relatively 'expensive' operation.

chromoxdor · 2023-10-27T11:52:30Z

Be aware that parsing Json is a relatively 'expensive' operation.

That i learned with my easy2ntfy project. So this is out of the question

Most likely the content of that Json will change somewhere in the future, breaking your fixed indexes 🤔

That is a risk i am willing to take. Either i would adjust the code or remove it completely.
As i see it we have two options here. Either we don´t integrate it at all or having it with the risk, that in the future it might break. But aren´t changes in code and structure and the adjustment to it anyway something we´ll always have to account for?

Edit:

Either i would adjust the code or remove it completely.

I mean it is not added yet anyhow... :)
But it would be a nice extra. And as i already mentioned i would like to make it only availablefor custom builds...

tonhuisman · 2023-10-27T12:22:17Z

But it would be a nice extra.

Yes, but the same goes for a lot of similar services, think of Weather Underground, Yahoo weather, your local weather service, etc.
Don't think we should try to add that to a Custom build only, but better find a more generic way of handling a HTTP GET/PUT/POST returned value. (that would be compile-time optional, of course)

Mostly limited by a lack of time/resources, but good ideas are always welcome & helpful. (I have some brewing in my head, I'll try to write them down 😸)

chromoxdor · 2023-10-27T12:36:47Z

Yes, but the same goes for a lot of similar services, think of Weather Underground, Yahoo weather, your local weather service, etc.

Absolutely.. but in general i couldn´t find a better API than that of openweathermap. I mean that in terms of free calls per day and length of the response. Because even if we had a nice json parser, i would imagine the esp8266 to suffer or even left out.
And again having the existing solution is better than no solution at all. And while having it we still can rack our brains over finding a more general solution.
I mean.. look at this old forum entry i linked. This unknown guy Ath said back then he can help...this is now 2.5 years ago. 😁

TD-er · 2023-10-28T20:28:35Z

Hmm, code for specific interacting with some external service and providing code to parse specific syntax...

Looks a lot like a "controller" for ESPEasy, doesn't it?

chromoxdor · 2023-10-29T15:35:39Z

Dear @TD-er,
can I smuggle this in?

I will leave this for now and maybe we´ll find a controller solution for it in the future
For now @TD-er can you restart the build?

tonhuisman · 2023-10-29T16:01:53Z

can you restart the build?

If you update to mega with the "Update branch" button, then it will have the fix that failed the last build.

…nto reply-event-for-thingspeak

chromoxdor added 3 commits October 23, 2023 19:18

Update Networking.cpp

4060dad

Update Networking.cpp

bb5ac3e

Update Networking.cpp

425aec4

make thinkspeak event optional

db1d7d9

chromoxdor added 2 commits October 25, 2023 13:50

compare also the last part of the uri to generate an event

6b5e249

add check if we got an answer otherwise we get -1 as a value

fb0f8ed

TD-er reviewed Oct 25, 2023

View reviewed changes

src/src/Helpers/Networking.cpp Outdated Show resolved Hide resolved

TD-er reviewed Oct 25, 2023

View reviewed changes

src/src/Helpers/Networking.cpp Outdated Show resolved Hide resolved

TD-er reviewed Oct 25, 2023

View reviewed changes

src/src/Helpers/Networking.cpp Outdated Show resolved Hide resolved

TD-er reviewed Oct 25, 2023

View reviewed changes

src/src/Helpers/Networking.cpp Outdated Show resolved Hide resolved

chromoxdor added 2 commits October 25, 2023 16:16

Update Networking.cpp

197dc10

Update Networking.cpp

4c934d4

TD-er reviewed Oct 25, 2023

View reviewed changes

src/src/Helpers/Networking.cpp Show resolved Hide resolved

chromoxdor added 2 commits October 25, 2023 17:18

Update define_plugin_sets.h

4ad08ac

Update define_plugin_sets.h

ad5e2ea

TD-er reviewed Oct 25, 2023

View reviewed changes

src/src/Helpers/Networking.cpp Outdated Show resolved Hide resolved

chromoxdor added 2 commits October 25, 2023 20:49

Update Networking.cpp

1ef66a4

Add ThingspeakReply to wordlist

5a689b2

tonhuisman reviewed Oct 25, 2023

View reviewed changes

src/src/Helpers/Networking.cpp Outdated Show resolved Hide resolved

tonhuisman reviewed Oct 25, 2023

View reviewed changes

src/src/Helpers/Networking.cpp Outdated Show resolved Hide resolved

Update Networking.cpp

89bf66c

chromoxdor added 3 commits October 25, 2023 22:31

Update Networking.cpp

600367b

added documentation

99b8156

Update Rules.rst

7d37637

Update Rules.rst

065efcd

chromoxdor added 3 commits October 29, 2023 17:32

Merge branch 'mega' into reply_event

8c2f5a2

a little formatting

ae3cbb9

Merge branch 'mega' into reply_event

61a8a28

chromoxdor closed this Nov 30, 2023

chromoxdor force-pushed the reply_event branch from 61a8a28 to 5cdeeae Compare November 30, 2023 16:07

chromoxdor added 2 commits November 30, 2023 17:12

Merge branch 'reply_event' of https://github.com/chromoxdor/ESPEasy i…

9756b8a

…nto reply-event-for-thingspeak

Update espeasy.min.js

967f940

chromoxdor reopened this Nov 30, 2023

chromoxdor added 7 commits November 30, 2023 17:39

Update Rules.rst

7f2a4ed

Merge branch 'letscontrolit:mega' into reply_event

33006a7

Merge branch 'mega' into reply_event

7c85873

Merge branch 'mega' into reply_event

bcae422

Merge branch 'mega' into reply_event

8967740

Merge branch 'letscontrolit:mega' into reply_event

1667923

Merge branch 'mega' into reply_event

c215acf

TD-er merged commit 481fe3b into letscontrolit:mega Jan 30, 2024
166 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[sendtohttp] thingspeak only reply event #4856

[sendtohttp] thingspeak only reply event #4856

chromoxdor commented Oct 25, 2023 •

edited

Loading

chromoxdor commented Oct 25, 2023 •

edited

Loading

chromoxdor commented Oct 25, 2023

chromoxdor commented Oct 25, 2023

tonhuisman commented Oct 25, 2023

chromoxdor commented Oct 25, 2023

chromoxdor commented Oct 26, 2023 •

edited

Loading

tonhuisman commented Oct 26, 2023

chromoxdor commented Oct 26, 2023

TD-er commented Oct 26, 2023

TD-er commented Oct 26, 2023 •

edited

Loading

chromoxdor commented Oct 27, 2023 •

edited

Loading

chromoxdor commented Oct 27, 2023

tonhuisman commented Oct 27, 2023

chromoxdor commented Oct 27, 2023 •

edited

Loading

tonhuisman commented Oct 27, 2023

chromoxdor commented Oct 27, 2023 •

edited

Loading

TD-er commented Oct 28, 2023

chromoxdor commented Oct 29, 2023

tonhuisman commented Oct 29, 2023

[sendtohttp] thingspeak only reply event #4856

[sendtohttp] thingspeak only reply event #4856

Conversation

chromoxdor commented Oct 25, 2023 • edited Loading

chromoxdor commented Oct 25, 2023 • edited Loading

chromoxdor commented Oct 25, 2023

chromoxdor commented Oct 25, 2023

tonhuisman commented Oct 25, 2023

chromoxdor commented Oct 25, 2023

chromoxdor commented Oct 26, 2023 • edited Loading

tonhuisman commented Oct 26, 2023

chromoxdor commented Oct 26, 2023

TD-er commented Oct 26, 2023

TD-er commented Oct 26, 2023 • edited Loading

chromoxdor commented Oct 27, 2023 • edited Loading

chromoxdor commented Oct 27, 2023

tonhuisman commented Oct 27, 2023

chromoxdor commented Oct 27, 2023 • edited Loading

tonhuisman commented Oct 27, 2023

chromoxdor commented Oct 27, 2023 • edited Loading

TD-er commented Oct 28, 2023

chromoxdor commented Oct 29, 2023

tonhuisman commented Oct 29, 2023

chromoxdor commented Oct 25, 2023 •

edited

Loading

chromoxdor commented Oct 25, 2023 •

edited

Loading

chromoxdor commented Oct 26, 2023 •

edited

Loading

TD-er commented Oct 26, 2023 •

edited

Loading

chromoxdor commented Oct 27, 2023 •

edited

Loading

chromoxdor commented Oct 27, 2023 •

edited

Loading

chromoxdor commented Oct 27, 2023 •

edited

Loading