Enphase multiple batteries - jq: too many results

[scholy]

Describe the bug

After installing 3 enphase solar batteries and reconfiguring evcc with the new controller, I see all the solar production and consumption data, but the battery SOC is not available. Checking through the logs, I can see evcc polls and receives the battery data from the IQ controller (GET https://192.168.3.126/ivp/ensemble/inventory), but it looks like evcc is expecting to see only 1 battery, producing the following error logs:
[site ] ERROR 2024/11/14 16:41:29 battery 1 soc: jq: too many results
[site ] DEBUG 2024/11/14 16:41:29 battery soc: 0%
[site ] DEBUG 2024/11/14 16:41:29 battery power: 0W

Steps to reproduce

1. configure enphase batter meter
2. configure site meters
3. restart evcc

...

Configuration details

network:
  schema: http
  host: evcc.local
  port: 7070

interval: 60s # control cycle interval

sponsortoken: <snip>

log: debug
levels:
  site: debug
  lp-1: debug
  lp-2: debug
  cache: error
  db: error

meters:
  - name: enphase_pv
    type: template
    template: enphase
    usage: pv
    host: 192.168.3.126
    token: <snip>
  - name: enphase_grid
    type: template
    template: enphase
    usage: grid
    host: 192.168.3.126
    token: <snip>
  - name: enphase_battery
    type: template
    template: enphase
    usage: battery
    host: 192.168.3.126
    token: <snip>
    capacity: 15

chargers:
  - name: TeslaCharger
    type: template # Wallbe charger
    template: twc3
    host: 192.168.3.200

vehicles:
  - name: ZROGAS
    type: template
    template: tesla
    icon: car
    commandProxy: http://192.168.1.78:8080
    accessToken: <snip>
    refreshToken: <snip>
    capacity: 78 # kWh
    vin: <snip>
    mode: pv

site:
  title: Home # display name for UI
  meters:
    grid: enphase_grid # grid meter
    pv: enphase_pv
    battery: enphase_battery
  residualPower: 0 
  maxGridSupplyWhileBatteryCharging: 0 

loadpoints:
  - title: Garage # display name for UI
    charger: TeslaCharger # charger
    mode: pv 
    vehicle: ZROGAS 
    phases: 3 
    minCurrent: 6 
    maxCurrent: 16 
    priority: 0 
    soc:
      poll:
        mode: connected
        interval: 5m
      estimate: true 
    enable: 
      delay: 5m 
      threshold: 0 
    disable: 
      delay: 3m 
      threshold: 0 
    guardDuration: 5m 

tariffs:
  currency: AUD 
  grid:
    type: fixed
    price: 0.3828 # EUR/kWh
    zones:
      - days: Mo-Fr
        hours: 0-6
        price: 0.0799
      - days: Mo-Fr
        hours: 11-14
        price: 0.00
      - days: Mo-Fr
        hours: 15-21
        price: 0.75
      - days: Sa,So
        hours: 0-6
        price: 0.0799
      - days: Sa,So
        hours: 11-14
        price: 0.00
  feedin:
    type: fixed
    price: 0.03 # EUR/kWh

  co2:
    type: template
    template: electricitymaps-free
    token: <snip>
    zone: AU-NSW

mqtt:
  broker: 192.168.0.10:1883
  topic: evcc 
  user: evcc
  password: <snip>

influx:
  url: http://192.168.0.10:8086
  database: evcc
  user: evcc
  password: <snip>

  services:

Log details

[main  ] INFO 2024/11/14 17:13:56 evcc 0.131.5 (6836749c)
[main  ] INFO 2024/11/14 17:13:56 using config file: /etc/evcc.yaml
[db    ] INFO 2024/11/14 17:13:56 using sqlite database: /var/lib/evcc/evcc.db
[mqtt  ] INFO 2024/11/14 17:13:57 connecting evcc-829667239 at tcp://192.168.0.10:1883
[mqtt  ] DEBUG 2024/11/14 17:13:57 tcp://192.168.0.10:1883 connected
[main  ] INFO 2024/11/14 17:13:57 listening at :7070
[lp-1  ] WARN 2024/11/14 17:13:58 poll mode '{connected 5m0s}' may deplete your battery or lead to API misuse. USE AT YOUR OWN RISK.
[lp-1  ] WARN 2024/11/14 17:13:58 deprecated: mincurrent setting is ignored, please remove
[lp-1  ] WARN 2024/11/14 17:13:58 deprecated: maxcurrent setting is ignored, please remove
[lp-1  ] WARN 2024/11/14 17:13:58 deprecated: phases setting is ignored, please remove
[site  ] INFO 2024/11/14 17:13:59 site config:
[site  ] INFO 2024/11/14 17:13:59   meters:      grid ✓ pv ✓ battery ✓
[site  ] INFO 2024/11/14 17:13:59     grid:      power ✓ energy ✗ currents ✗
[site  ] INFO 2024/11/14 17:13:59     pv 1:      power ✓ energy ✓ currents ✗
[site  ] INFO 2024/11/14 17:13:59     battery 1: power ✓ energy ✗ currents ✗ soc ✓ capacity ✓
[site  ] INFO 2024/11/14 17:13:59   vehicles:
[site  ] INFO 2024/11/14 17:13:59     vehicle 1: range ✓ finish ✓ status ✓ climate ✗ wakeup ✓
[lp-1  ] INFO 2024/11/14 17:13:59 loadpoint 1:
[lp-1  ] INFO 2024/11/14 17:13:59   mode:        pv
[lp-1  ] INFO 2024/11/14 17:13:59   charger:     power ✓ energy ✗ currents ✓ phases ✗ wakeup ✗
[lp-1  ] INFO 2024/11/14 17:13:59   meters:      charge ✓
[lp-1  ] INFO 2024/11/14 17:13:59     charge:    power ✓ energy ✗ currents ✓
[lp-1  ] DEBUG 2024/11/14 17:13:59 set smart cost limit: 0.1
[lp-1  ] DEBUG 2024/11/14 17:13:59 phase timer inactive
[lp-1  ] DEBUG 2024/11/14 17:13:59 pv timer inactive
[lp-1  ] INFO 2024/11/14 17:13:59 vehicle updated: unknown -> ZROGAS
[lp-1  ] DEBUG 2024/11/14 17:13:59 set charge mode: pv
[site  ] DEBUG 2024/11/14 17:13:59 ----
[lp-1  ] DEBUG 2024/11/14 17:13:59 charge power: 0W
[lp-1  ] DEBUG 2024/11/14 17:13:59 charge currents: [0.2 0.2 0.2]A
[enphase_battery] TRACE 2024/11/14 17:13:59 GET http://192.168.3.126/production.json
[enphase_grid] TRACE 2024/11/14 17:13:59 GET http://192.168.3.126/production.json
[enphase_pv] TRACE 2024/11/14 17:13:59 GET http://192.168.3.126/production.json
[enphase_grid] TRACE 2024/11/14 17:13:59 <html>
<head><title>301 Moved Permanently</title></head>
<body>
<center><h1>301 Moved Permanently</h1></center>
<hr><center>openresty/1.17.8.1</center>
</body>
</html>
[enphase_grid] TRACE 2024/11/14 17:13:59 GET https://192.168.3.126/production.json
[enphase_battery] TRACE 2024/11/14 17:13:59 <html>
<head><title>301 Moved Permanently</title></head>
<body>
<center><h1>301 Moved Permanently</h1></center>
<hr><center>openresty/1.17.8.1</center>
</body>
</html>
[enphase_battery] TRACE 2024/11/14 17:13:59 GET https://192.168.3.126/production.json
[enphase_pv] TRACE 2024/11/14 17:13:59 <html>
<head><title>301 Moved Permanently</title></head>
<body>
<center><h1>301 Moved Permanently</h1></center>
<hr><center>openresty/1.17.8.1</center>
</body>
</html>
[enphase_pv] TRACE 2024/11/14 17:13:59 GET https://192.168.3.126/production.json
[enphase_pv] TRACE 2024/11/14 17:14:03 {"production":[{"type":"inverters","activeCount":25,"readingTime":1731564828,"wNow":1092,"whLifetime":3259},{"type":"eim","activeCount":1,"measurementType":"production","readingTime":1731564843,"wNow":980.327,"whLifetime":2715.616,"varhLeadLifetime":378.282,"varhLagLifetime":159.072,"vahLifetime":2900.22,"rmsCurrent":4.537,"rmsVoltage":719.23,"reactPwr":-274.146,"apprntPwr":1089.898,"pwrFactor":0.89,"whToday":2715.616,"whLastSevenDays":70.616,"vahToday":2900.22,"varhLeadToday":378.282,"varhLagToday":159.072}],"consumption":[{"type":"eim","activeCount":1,"measurementType":"total-consumption","readingTime":1731564843,"wNow":3825.946,"whLifetime":4372.541,"varhLeadLifetime":996.552,"varhLagLifetime":340.266,"vahLifetime":4225.109,"rmsCurrent":17.731,"rmsVoltage":719.433,"reactPwr":-494.591,"apprntPwr":4251.43,"pwrFactor":0.9,"whToday":4372.541,"whLastSevenDays":253.541,"vahToday":4225.109,"varhLeadToday":996.552,"varhLagToday":340.266},{"type":"eim","activeCount":1,"measurementType":"net-consumption","readingTime":1731564843,"wNow":2845.619,"whLifetime":2125.92,"varhLeadLifetime":1374.834,"varhLagLifetime":499.338,"vahLifetime":4225.109,"rmsCurrent":13.194,"rmsVoltage":719.433,"reactPwr":-220.445,"apprntPwr":3162.347,"pwrFactor":0.9,"whToday":0,"whLastSevenDays":0,"vahToday":0,"varhLeadToday":0,"varhLagToday":0}],"storage":[{"type":"acb","activeCount":0,"readingTime":0,"wNow":0,"whNow":0,"state":"idle"}]}
[enphase_pv] TRACE 2024/11/14 17:14:03 GET http://192.168.3.126/production.json
[enphase_pv] TRACE 2024/11/14 17:14:03 <html>
<head><title>301 Moved Permanently</title></head>
<body>
<center><h1>301 Moved Permanently</h1></center>
<hr><center>openresty/1.17.8.1</center>
</body>
</html>
[enphase_pv] TRACE 2024/11/14 17:14:03 GET https://192.168.3.126/production.json
[enphase_battery] TRACE 2024/11/14 17:14:05 {"production":[{"type":"inverters","activeCount":25,"readingTime":1731564828,"wNow":1092,"whLifetime":3259},{"type":"eim","activeCount":1,"measurementType":"production","readingTime":1731564844,"wNow":980.701,"whLifetime":2715.888,"varhLeadLifetime":378.369,"varhLagLifetime":159.074,"vahLifetime":2900.525,"rmsCurrent":4.559,"rmsVoltage":719.658,"reactPwr":-282.044,"apprntPwr":1092.346,"pwrFactor":0.89,"whToday":2715.888,"whLastSevenDays":70.888,"vahToday":2900.525,"varhLeadToday":378.369,"varhLagToday":159.074}],"consumption":[{"type":"eim","activeCount":1,"measurementType":"total-consumption","readingTime":1731564844,"wNow":3823.969,"whLifetime":4373.602,"varhLeadLifetime":996.621,"varhLagLifetime":340.392,"vahLifetime":4225.99,"rmsCurrent":17.77,"rmsVoltage":719.867,"reactPwr":-473.452,"apprntPwr":4263.629,"pwrFactor":0.89,"whToday":4373.602,"whLastSevenDays":254.602,"vahToday":4225.99,"varhLeadToday":996.621,"varhLagToday":340.392},{"type":"eim","activeCount":1,"measurementType":"net-consumption","readingTime":1731564844,"wNow":2843.269,"whLifetime":2126.709,"varhLeadLifetime":1374.99,"varhLagLifetime":499.466,"vahLifetime":4225.99,"rmsCurrent":13.211,"rmsVoltage":719.867,"reactPwr":-191.408,"apprntPwr":3168.734,"pwrFactor":0.89,"whToday":0,"whLastSevenDays":0,"vahToday":0,"varhLeadToday":0,"varhLagToday":0}],"storage":[{"type":"acb","activeCount":0,"readingTime":0,"wNow":0,"whNow":0,"state":"idle"}]}
[enphase_battery] TRACE 2024/11/14 17:14:05 GET http://192.168.3.126/ivp/ensemble/inventory
[enphase_battery] TRACE 2024/11/14 17:14:05 <html>
<head><title>301 Moved Permanently</title></head>
<body>
<center><h1>301 Moved Permanently</h1></center>
<hr><center>openresty/1.17.8.1</center>
</body>
</html>
[enphase_battery] TRACE 2024/11/14 17:14:05 GET https://192.168.3.126/ivp/ensemble/inventory
[enphase_battery] TRACE 2024/11/14 17:14:05 [
    {
        "type": "ENCHARGE",
        "devices": [
            {
                "part_num": "836-01837-r53",
                "serial_num": "492320005652",
                "installed": 1731557879,
                "device_status": [
                    "envoy.global.ok",
                    "prop.done"
                ],
                "last_rpt_date": 1731564603,
                "admin_state": 6,
                "admin_state_str": "ENCHG_STATE_READY",
                "created_date": 1731557879,
                "img_load_date": 1731557879,
                "img_pnum_running": "3.0.5949_rel/31.07",
                "bmu_fw_version": "3.8.53",
                "communicating": true,
                "sleep_enabled": false,
                "percentFull": 27,
                "temperature": 23,
                "maxCellTemp": 23,
                "comm_level_sub_ghz": 0,
                "comm_level_2_4_ghz": 0,
                "led_status": 12,
                "dc_switch_off": false,
                "encharge_rev": 3,
                "encharge_capacity": 4960,
                "phase": "ph-a",
                "der_index": 1
            },
            {
                "part_num": "836-01837-r53",
                "serial_num": "492320005657",
                "installed": 1731557251,
                "device_status": [
                    "envoy.global.ok",
                    "prop.done"
                ],
                "last_rpt_date": 1731564718,
                "admin_state": 6,
                "admin_state_str": "ENCHG_STATE_READY",
                "created_date": 1731557251,
                "img_load_date": 1731557251,
                "img_pnum_running": "3.0.5949_rel/31.07",
                "bmu_fw_version": "3.8.53",
                "communicating": true,
                "sleep_enabled": false,
                "percentFull": 27,
                "temperature": 23,
                "maxCellTemp": 23,
                "comm_level_sub_ghz": 0,
                "comm_level_2_4_ghz": 0,
                "led_status": 12,
                "dc_switch_off": false,
                "encharge_rev": 3,
                "encharge_capacity": 4960,
                "phase": "ph-a",
                "der_index": 1
            },
            {
                "part_num": "836-01837-r53",
                "serial_num": "492320010893",
                "installed": 1731557882,
                "device_status": [
                    "envoy.global.ok",
                    "prop.done"
                ],
                "last_rpt_date": 1731564620,
                "admin_state": 6,
                "admin_state_str": "ENCHG_STATE_READY",
                "created_date": 1731557882,
                "img_load_date": 1731557882,
                "img_pnum_running": "3.0.5949_rel/31.07",
                "bmu_fw_version": "3.8.53",
                "communicating": true,
                "sleep_enabled": false,
                "percentFull": 27,
                "temperature": 23,
                "maxCellTemp": 23,
                "comm_level_sub_ghz": 0,
                "comm_level_2_4_ghz": 0,
                "led_status": 12,
                "dc_switch_off": false,
                "encharge_rev": 3,
                "encharge_capacity": 4960,
                "phase": "ph-a",
                "der_index": 1
            }
        ]
    },
    {
        "type": "ENPOWER",
        "devices": [
            {
                "part_num": "860-01801-r64",
                "serial_num": "122405002386",
                "installed": 1731557245,
                "device_status": [
                    "envoy.global.ok",
                    "prop.done"
                ],
                "last_rpt_date": 1731564835,
                "admin_state": 24,
                "admin_state_str": "ENPWR_STATE_OPER_CLOSED",
                "created_date": 1731557245,
                "img_load_date": 1731557245,
                "img_pnum_running": "2.7.5554_rel/31.11",
                "communicating": true,
                "temperature": 79,
                "comm_level_sub_ghz": 0,
                "comm_level_2_4_ghz": 0,
                "mains_admin_state": "closed",
                "mains_oper_state": "closed",
                "Enpwr_grid_mode": "multimode-ongrid",
                "Enchg_grid_mode": "multimode-ongrid",
                "Enpwr_relay_state_bm": 62415,
                "Enpwr_curr_state_id": 16
            }
        ]
    }
]
[site  ] ERROR 2024/11/14 17:14:05 battery 1 soc: jq: too many results
[site  ] DEBUG 2024/11/14 17:14:05 battery soc: 0%
[site  ] DEBUG 2024/11/14 17:14:05 battery power: 0W
[enphase_grid] TRACE 2024/11/14 17:14:06 {"production":[{"type":"inverters","activeCount":25,"readingTime":1731564828,"wNow":1092,"whLifetime":3259},{"type":"eim","activeCount":1,"measurementType":"production","readingTime":1731564846,"wNow":977.991,"whLifetime":2716.431,"varhLeadLifetime":378.572,"varhLagLifetime":159.077,"vahLifetime":2901.147,"rmsCurrent":4.649,"rmsVoltage":721.078,"reactPwr":-338.643,"apprntPwr":1111.89,"pwrFactor":0.88,"whToday":2716.431,"whLastSevenDays":71.431,"vahToday":2901.147,"varhLeadToday":378.572,"varhLagToday":159.077}],"consumption":[{"type":"eim","activeCount":1,"measurementType":"total-consumption","readingTime":1731564846,"wNow":3817.776,"whLifetime":4375.72,"varhLeadLifetime":996.672,"varhLagLifetime":340.675,"vahLifetime":4227.765,"rmsCurrent":17.949,"rmsVoltage":721.294,"reactPwr":-342.813,"apprntPwr":4315.922,"pwrFactor":0.88,"whToday":4375.72,"whLastSevenDays":256.72,"vahToday":4227.765,"varhLeadToday":996.672,"varhLagToday":340.675},{"type":"eim","activeCount":1,"measurementType":"net-consumption","readingTime":1731564846,"wNow":2839.785,"whLifetime":2128.285,"varhLeadLifetime":1375.244,"varhLagLifetime":499.752,"vahLifetime":4227.765,"rmsCurrent":13.301,"rmsVoltage":721.294,"reactPwr":-4.17,"apprntPwr":3197.011,"pwrFactor":0.89,"whToday":0,"whLastSevenDays":0,"vahToday":0,"varhLeadToday":0,"varhLagToday":0}],"storage":[{"type":"acb","activeCount":0,"readingTime":0,"wNow":0,"whNow":0,"state":"idle"}]}
[site  ] DEBUG 2024/11/14 17:14:06 grid power: 2840W
[enphase_pv] TRACE 2024/11/14 17:14:08 {"production":[{"type":"inverters","activeCount":25,"readingTime":1731564828,"wNow":1092,"whLifetime":3259},{"type":"eim","activeCount":1,"measurementType":"production","readingTime":1731564848,"wNow":975.066,"whLifetime":2717.0,"varhLeadLifetime":378.784,"varhLagLifetime":159.08,"vahLifetime":2901.799,"rmsCurrent":4.643,"rmsVoltage":721.165,"reactPwr":-360.793,"apprntPwr":1118.314,"pwrFactor":0.87,"whToday":2717.0,"whLastSevenDays":72.0,"vahToday":2901.799,"varhLeadToday":378.784,"varhLagToday":159.08}],"consumption":[{"type":"eim","activeCount":1,"measurementType":"total-consumption","readingTime":1731564848,"wNow":3817.053,"whLifetime":4377.946,"varhLeadLifetime":996.732,"varhLagLifetime":340.967,"vahLifetime":4229.629,"rmsCurrent":17.943,"rmsVoltage":721.379,"reactPwr":-306.994,"apprntPwr":4314.775,"pwrFactor":0.89,"whToday":4377.946,"whLastSevenDays":258.946,"vahToday":4229.629,"varhLeadToday":996.732,"varhLagToday":340.967},{"type":"eim","activeCount":1,"measurementType":"net-consumption","readingTime":1731564848,"wNow":2841.988,"whLifetime":2129.942,"varhLeadLifetime":1375.516,"varhLagLifetime":500.047,"vahLifetime":4229.629,"rmsCurrent":13.3,"rmsVoltage":721.379,"reactPwr":53.798,"apprntPwr":3197.198,"pwrFactor":0.89,"whToday":0,"whLastSevenDays":0,"vahToday":0,"varhLeadToday":0,"varhLagToday":0}],"storage":[{"type":"acb","activeCount":0,"readingTime":0,"wNow":0,"whNow":0,"state":"idle"}]}
[site  ] DEBUG 2024/11/14 17:14:08 pv power: 1092W
[site  ] DEBUG 2024/11/14 17:14:08 site power: 2840W
[lp-1  ] DEBUG 2024/11/14 17:14:09 charge voltages: [4.7 1.1 0]V
[lp-1  ] DEBUG 2024/11/14 17:14:09 charger status: A
[lp-1  ] INFO 2024/11/14 17:14:09 car disconnected
[lp-1  ] DEBUG 2024/11/14 17:14:09 set charge mode: pv
[lp-1  ] DEBUG 2024/11/14 17:14:09 set battery boost: false
[lp-1  ] DEBUG 2024/11/14 17:14:09 set session soc limit: 0
[lp-1  ] DEBUG 2024/11/14 17:14:09 set session energy limit: 0

What type of operating system are you running?

Linux

Nightly build

• I have verified that the issue is reproducible with the latest nightly build

Version

evcc version 0.131.5 (6836749)

[andig]

The template's jq query needs be updated and a battery number added. Happy to take a PR.

Update looks like this should already handle >1 battery, not sure why this doesn't work:

jq: .[].devices | map(.percentFull) | add / length

/cc @premultiply lokal kann ich das gar nicht testen, aber mit anderem Fehler:

❯ cat enphase.json | jq ".[].devices | map(.percentFull) | add / length"
27
jq: error (at <stdin>:123): null (null) and number (1) cannot be divided

[scholy]

Could the issue be the 2 top level arrays of ENPOWER and ENCHARGE? Both return devices, only ENCHARGE is will return percentFull values.

Is the intended bahaviour to average the percentFull values? I'm curious as the log files seems to indicate battery numbers"
ERROR 2024/11/14 17:14:05 **battery 1 soc**: jq: too many results [site ] DEBUG 2024/11/14 17:14:05 battery soc: 0% [site ] DEBUG 2024/11/14 17:14:05 battery power: 0W

I'll try playing around with a custom meter and the jq

[scholy]

Fixed in a custom meter with:
jq: '[.[].devices[] | select(.percentFull != null) | .percentFull] | add / length'

full custom meter:

- name: enphase_custom
    type: custom
    power:
      source: http
      uri: https://192.168.3.126/production.json
      auth:
        type: bearer
        password: <enphase token>
      insecure: true
      jq: '.storage[] | .wNow'
      timeout: 60s
    soc:
      source: http
      uri: https://192.168.3.126/ivp/ensemble/inventory
      auth:
        type: bearer
        password: <enphase token>
      insecure: true
      jq: '[.[].devices[] | select(.percentFull != null) | .percentFull] | add / length'
      timeout: 60s

Edit: I have a new battery install with 3x 5P batteries and IQ System Controller 3 INT. I have no way to test this on Enphases other battery and install types .

[andig]

Perfect- happy to take a PR!

[premultiply]

Every battery unit should be added as own device for configuration. evcc will sum up the measurands internally where required.

[andig]

Bitte nicht komplizierter machen als notwendig. Hier gehts erstmal überhaupt um die richtige Formel, ees fehlt nur der PR.

[premultiply]

Eben, daher ja die Bitte keine komplizierten und ggf. falschen Formeln zu verwenden sondern einfach mit dem jeweiligen Index auf die jeweilige Speicher-Einheit einzeln zuzugreifen.
Hier fehlt nämlich derzeit die Kapazität der einzelnen Module, so dass der SoC bei unterschiedlichen Speichereinheiten falsch wäre.

[andig]

Darum geht es hier aber nicht. Bitte nicht alles durcheinander mischen. Bei Stapelspeichern passt das wunderbar.

[premultiply]

Das sind mwn. alles einzelne Speichereinheiten mit AC-Anschluss, keine gestapelten DC-Module.

[andig]

Yep, hat mit diesem Issue aber trotzdem nix zu tun 😉