DynamoDBMapper with DynamoDBMapperConfig used for query against GSI throws error

[codecheetos]

I need help in troubleshooting issue with using DynamoDBMapper with DynamoDBMapperConfig object and using it to query against GSI. Here is my stacktrace.

Caused by: com.amazonaws.services.dynamodbv2.model.AmazonDynamoDBException: Consistent read cannot be true when querying a GSI (Service: AmazonDynamoDBv2; Status Code: 400; Error Code: ValidationException; Request ID: 5ccc95a6-c3c4-4166-9dca-0f3c23b7a2b3; Proxy: null)
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleErrorResponse(AmazonHttpClient.java:1879) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleServiceErrorResponse(AmazonHttpClient.java:1418) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeOneRequest(AmazonHttpClient.java:1387) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1157) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:814) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeWithTimer(AmazonHttpClient.java:781) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.execute(AmazonHttpClient.java:755) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient$RequestExecutor.access$500(AmazonHttpClient.java:715) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient$RequestExecutionBuilderImpl.execute(AmazonHttpClient.java:697) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:561) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:541) ~[aws-java-sdk-core-1.12.301.jar:na]
        at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.doInvoke(AmazonDynamoDBClient.java:6409) ~[aws-java-sdk-dynamodb-1.12.301.jar:na]
        at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.invoke(AmazonDynamoDBClient.java:6376) ~[aws-java-sdk-dynamodb-1.12.301.jar:na]
        at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.executeQuery(AmazonDynamoDBClient.java:4123) ~[aws-java-sdk-dynamodb-1.12.301.jar:na]
        at com.amazonaws.services.dynamodbv2.AmazonDynamoDBClient.query(AmazonDynamoDBClient.java:4087) ~[aws-java-sdk-dynamodb-1.12.301.jar:na]
        at com.amazonaws.services.dynamodbv2.datamodeling.DynamoDBMapper.query(DynamoDBMapper.java:1618) ~[aws-java-sdk-dynamodb-1.12.301.jar:na]
        at cargeotracker.DatastoreMgr.getCarGeoTrackerModels(DatastoreMgr.java:192) ~[cargeotracker-0.0.1-SNAPSHOT.jar:na]

I'm using gradle to build and run a quartz based scheduled job to query from a GSI index and perform some automation...

    implementation 'com.amazonaws:aws-java-sdk:1.11.1000'
    implementation 'com.amazonaws:aws-java-sdk-dynamodb:1.12.301'

I understand that GSI needs to use DynamoDBMapperConfig with ConsistentReads.EVENTUAL and this is how I'm configuring the object and using it. Before doing the query, I'm confirming that consistency is EVENTUAL, but not sure why it keeps complaining Consistent read cannot be true when querying a GSI.

        DynamoDBMapper mapper = new DynamoDBMapper(client);

        DynamoDBMapperConfig dynamoMapperBuilderCfg = DynamoDBMapperConfig.builder()
                .withConsistentReads(DynamoDBMapperConfig.ConsistentReads.EVENTUAL)
                .withPaginationLoadingStrategy(DynamoDBMapperConfig.PaginationLoadingStrategy.ITERATION_ONLY)
                .withSaveBehavior(DynamoDBMapperConfig.SaveBehavior.CLOBBER).build();

        System.out.println("==================");
        System.out.println(dynamoMapperBuilderCfg.getConsistentReads());
        System.out.println("==================");
....
        DynamoDBQueryExpression<CarGeoTrackerModel> queryExpression = new DynamoDBQueryExpression<CarGeoTrackerModel>()
                .withKeyConditionExpression("geo_location_code = :glc")
                .withIndexName("geo_loc_index")
                .withFilterExpression("attribute_not_exists(notified_ts) or updated_ts > notified_ts ")
                // additionally check for current_timestamp < updated_ts + 30-min-tolerance
                .withExpressionAttributeValues(eav);

        PaginatedQueryList<CarGeoTrackerModel> activeGeoCodes = mapper.query(CarGeoTrackerModel.class, queryExpression, dynamoMapperBuilderCfg);

... prints EVENTUAL.

Finally, the CarGeoTrackerModel class is defined with @DynamoDBIndexHashKey as follows...

    @DynamoDBIndexHashKey(attributeName="geo_location_code", globalSecondaryIndexName="geo_loc_index")
    public String getGeoLocationCode() {
        return this.geoLocationCode;
    }

    public void setGeoLocationCode(String geoLocationCode) {
        this.geoLocationCode = geoLocationCode;
    }

Any suggestions on what am I doing wrong? I tried to step debug in intellij but error is happening on DynamoDB server (which is running locally on docker). Here is my docker container.

akundu@RIV-594072M eventaggregator % docker-compose up
Recreating dynamodb-local ... done
Attaching to dynamodb-local
dynamodb-local    | Initializing DynamoDB Local with the following configuration:
dynamodb-local    | Port:	8000
dynamodb-local    | InMemory:	false
dynamodb-local    | DbPath:	./data
dynamodb-local    | SharedDb:	true
dynamodb-local    | shouldDelayTransientStatuses:	false
dynamodb-local    | CorsParams:	null
dynamodb-local    | 
...

My docker-compose.yml has this and see no errors in container logs.

version: '3.8'
services:
  dynamodb-local:
    command: "-jar DynamoDBLocal.jar -sharedDb -dbPath ./data"
    image: "amazon/dynamodb-local:latest"
    container_name: dynamodb-local
    ports:
      - "8000:8000"
    volumes:
      - "./docker/dynamodb:/home/dynamodblocal/data"
    working_dir: /home/dynamodblocal

When I use CLI with --endpoint-url http://localhost:8000 --region us-east-1 with correct query arguments, the result is returned successfully, which is leading me to believe that its either SDK or my usage (99% likely) issue.

% aws dynamodb query --table-name car_geo_tracker --index-name geo_loc_index --key-condition-expression "geo_location_code = :v1" --filter-expression "attribute_exists(coid_active_exp_ttl)" --expression-attribute-values '{":v1": {"S": "ACTIVE_GEO"}}' --endpoint-url http://localhost:8000 --region us-east-1
...

[codecheetos]

Using this doc as reference.

https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/DynamoDBMapper.QueryScanExample.html