IBM Support

Resolving Limit of total fields [1000] has been exceeded Error in API Connect Analytics Offload to Elasticsearch

Troubleshooting


Problem

When offloading analytics data from IBM API Connect to Elasticsearch, users may observe numerous status=> 400 error messages in the api-analytics-ingestion pds. However, the offload appears to be functioning in Elasticsearch despite these errors. 
Example Log Output 
kubectl logs pod/<analytics_ingestion_pod> -n <namespace_where_APIC_is_deployed>

[<timestamp>][WARN ][logstash.outputs.elasticsearch] Could not index event to Elasticsearch. {
    :status=>400, 
    :action=>["index", {
            :_id=>nil, 
            :_index=>"apiconnect....."}], 
    :response=>{
            "index"=>{..., 
                "status"=>400, "error"=>{
                    "type"=>"document_parsing_exception", 
                    "reason"=>"[1:2457] failed to parse: Limit of total fields [1000] has been exceeded while adding new fields [2]", 
                    "caused_by"=>{
                        "type"=>"illegal_argument_exception", 
                        "reason"=>"Limit of total fields [1000] has been exceeded while adding new fields [2]"}}}}}

Document Location

Worldwide

[{"Type":"MASTER","Line of Business":{"code":"LOB77","label":"Automation Platform"},"Business Unit":{"code":"BU048","label":"IBM Software"},"Product":{"code":"SSMNED","label":"IBM API Connect"},"ARM Category":[{"code":"a8mKe000000CaZQIA0","label":"API Connect-\u003EAPIC Analytics"}],"ARM Case Number":"TS018440637","Platform":[{"code":"PF025","label":"Platform Independent"}],"Version":"10.0.8;and future releases"}]

Log InLog in to view more of this document

This document has the abstract of a technical article that is available to authorized users once you have logged on. Please use Log in button above to access the full document. After log in, if you do not have the right authorization for this document, there will be instructions on what to do next.

Document Information

Modified date:
10 March 2025

UID

ibm17185289