Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flink Job is not started automatically on deployment of Flink job cluster on Flink operator v0.4.0 #161

Closed
anekdoti opened this issue Jan 15, 2020 · 5 comments

Comments

@anekdoti
Copy link

I updated to version 0.4.0 of the flink operator following the current quick start documentation.
It seems that issue #129 (Flink Job is not started automatically on deployment of Flink job cluster) is open again.

More specifically, adding the FlinkApplication resource of the wordcount-operator-example (in a namespace team1) creates pods for JobManager and TaskManagers and the Web UI of the JobManager is usable, but the wordcount streaming job is not started automatically.

kubectl describe pod ${jobmanager_pod} -n team1 -o yaml gives

Name:               wordcount-operator-example-cbb38a77-jm-68d8f8755d-82l6r
Namespace:          team1
Priority:           0
PriorityClassName:  <none>
Node:               1312de0a-c45b-4354-a6fa-1ccef0857e86/172.25.2.3
Start Time:         Wed, 15 Jan 2020 15:08:07 +0100
Labels:             environment=development
                    flink-app=wordcount-operator-example
                    flink-app-hash=cbb38a77
                    flink-deployment-type=jobmanager
                    fluxcd.io/sync-gc-mark=sha256.SeVJimbi_kyPgzgGlBuaKO6nWNw-Q004mSFX0GBWIos
                    pod-template-hash=68d8f8755d
Annotations:        fluxcd.io/sync-checksum: 7d11c42020e67e0187526270e416499f830b1dc0
                    kubectl.kubernetes.io/last-applied-configuration:
                      {"apiVersion":"flink.k8s.io/v1beta1","kind":"FlinkApplication","metadata":{"annotations":{"fluxcd.io/sync-checksum":"7d11c42020e67e0187526...
Status:             Running
IP:                 172.26.31.8
Controlled By:      ReplicaSet/wordcount-operator-example-cbb38a77-jm-68d8f8755d
Containers:
  jobmanager:
    Container ID:  docker://25111652b809fd9ada5ce0a1cc7a7431b20115da517c87d40717403701686005
    Image:         docker.io/lyft/wordcount-operator-example:8630a9b2ba760b13804b86c50b46352cbe3b89c8
    Image ID:      docker-pullable://lyft/wordcount-operator-example@sha256:a3d52498927e8d885c687e0ca7faebcf6f807c922b4f354fdcd80179ab84b485
    Ports:         6123/TCP, 6125/TCP, 6124/TCP, 8081/TCP, 50101/TCP
    Host Ports:    0/TCP, 0/TCP, 0/TCP, 0/TCP, 0/TCP
    Args:
      jobmanager
    State:          Running
      Started:      Wed, 15 Jan 2020 15:08:09 +0100
    Ready:          True
    Restart Count:  0
    Requests:
      cpu:      200m
      memory:   1000Mi
    Readiness:  http-get http://:8081/overview delay=10s timeout=1s period=5s #success=1 #failure=2
    Environment:
      AWS_METADATA_SERVICE_TIMEOUT:       5
      AWS_METADATA_SERVICE_NUM_ATTEMPTS:  20
      APP_NAME:                           wordcount-operator-example
      OPERATOR_FLINK_CONFIG:              blob.server.port: 6125
                                          jobmanager.heap.size: 512000k
                                          jobmanager.rpc.port: 6123
                                          jobmanager.web.port: 8081
                                          metrics.internal.query-service.port: 50101
                                          query.server.port: 6124
                                          state.backend.fs.checkpointdir: file:///checkpoints/flink/checkpoints
                                          state.checkpoints.dir: file:///checkpoints/flink/externalized-checkpoints
                                          state.savepoints.dir: file:///checkpoints/flink/savepoints
                                          taskmanager.heap.size: 512000k
                                          taskmanager.numberOfTaskSlots: 2

                                          jobmanager.rpc.address: wordcount-operator-example-cbb38a77

      FLINK_PROPERTIES:                   blob.server.port: 6125
                                          jobmanager.heap.size: 512000k
                                          jobmanager.rpc.port: 6123
                                          jobmanager.web.port: 8081
                                          metrics.internal.query-service.port: 50101
                                          query.server.port: 6124
                                          state.backend.fs.checkpointdir: file:///checkpoints/flink/checkpoints
                                          state.checkpoints.dir: file:///checkpoints/flink/externalized-checkpoints
                                          state.savepoints.dir: file:///checkpoints/flink/savepoints
                                          taskmanager.heap.size: 512000k
                                          taskmanager.numberOfTaskSlots: 2

                                          jobmanager.rpc.address: wordcount-operator-example-cbb38a77

      HOST_NAME:                          wordcount-operator-example-cbb38a77-jm-68d8f8755d-82l6r (v1:metadata.name)
      HOST_IP:                             (v1:status.podIP)
      FLINK_DEPLOYMENT_TYPE:              jobmanager
    Mounts:
      /conf from kafka-environments-config (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from default-token-dl42c (ro)
Conditions:
  Type              Status
  Initialized       True
  Ready             True
  ContainersReady   True
  PodScheduled      True
Volumes:
  kafka-environments-config:
    Type:      ConfigMap (a volume populated by a ConfigMap)
    Name:      kafka-environments-config
    Optional:  false
  default-token-dl42c:
    Type:        Secret (a volume populated by a Secret)
    SecretName:  default-token-dl42c
    Optional:    false
QoS Class:       Burstable
Node-Selectors:  <none>
Tolerations:     node.kubernetes.io/not-ready:NoExecute for 300s
                 node.kubernetes.io/unreachable:NoExecute for 300s
Events:
  Type    Reason     Age   From                                           Message
  ----    ------     ----  ----                                           -------
  Normal  Scheduled  24m   default-scheduler                              Successfully assigned team1/wordcount-operator-example-cbb38a77-jm-68d8f8755d-82l6r to 1312de0a-c45b-4354-a6fa-1ccef0857e86
  Normal  Pulled     24m   kubelet, 1312de0a-c45b-4354-a6fa-1ccef0857e86  Container image "docker.io/lyft/wordcount-operator-example:8630a9b2ba760b13804b86c50b46352cbe3b89c8" already present on machine
  Normal  Created    24m   kubelet, 1312de0a-c45b-4354-a6fa-1ccef0857e86  Created container jobmanager
  Normal  Started    24m   kubelet, 1312de0a-c45b-4354-a6fa-1ccef0857e86  Started container jobmanager

and the log of the jobmanager pod is

state.backend.fs.checkpointdir: file:///checkpoints/flink/checkpoints
state.checkpoints.dir: file:///checkpoints/flink/externalized-checkpoints
state.savepoints.dir: file:///checkpoints/flink/savepoints
taskmanager.heap.size: 512000k
taskmanager.numberOfTaskSlots: 2
jobmanager.rpc.address: wordcount-operator-example-cbb38a77
Starting standalonesession as a console application on host wordcount-operator-example-cbb38a77-jm-68d8f8755d-82l6r.
2020-01-15 14:08:10,552 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - --------------------------------------------------------------------------------
2020-01-15 14:08:10,555 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  Starting StandaloneSessionClusterEntrypoint (Version: 1.8.2, Rev:6322618, Date:04.09.2019 @ 22:07:41 CST)
2020-01-15 14:08:10,555 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  OS current user: flink
2020-01-15 14:08:10,555 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  Current Hadoop/Kerberos user: <no hadoop dependency found>
2020-01-15 14:08:10,555 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.212-b01
2020-01-15 14:08:10,555 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  Maximum heap size: 483 MiBytes
2020-01-15 14:08:10,555 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  JAVA_HOME: /docker-java-home
2020-01-15 14:08:10,556 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  No Hadoop Dependency available
2020-01-15 14:08:10,556 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  JVM Options:
2020-01-15 14:08:10,556 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -     -Xms500m
2020-01-15 14:08:10,556 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -     -Xmx500m
2020-01-15 14:08:10,556 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -     -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
2020-01-15 14:08:10,556 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -     -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
2020-01-15 14:08:10,556 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  Program Arguments:
2020-01-15 14:08:10,556 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -     --configDir
2020-01-15 14:08:10,556 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -     /opt/flink/conf
2020-01-15 14:08:10,557 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -     --executionMode
2020-01-15 14:08:10,557 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -     cluster
2020-01-15 14:08:10,557 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         -  Classpath: /opt/flink/lib/flink-s3-fs-hadoop-1.8.2.jar:/opt/flink/lib/flink-s3-fs-presto-1.8.2.jar:/opt/flink/lib/log4j-1.2.17.jar:/opt/flink/lib/slf4j-log4j12-1.7.15.jar:/opt/flink/lib/flink-dist_2.12-1.8.2.jar:::
2020-01-15 14:08:10,557 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - --------------------------------------------------------------------------------
2020-01-15 14:08:10,558 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Registered UNIX signal handlers for [TERM, HUP, INT]
2020-01-15 14:08:10,613 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.web.submit.enable, true
2020-01-15 14:08:10,613 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.web.log.path, /var/log/jobmanager/current
2020-01-15 14:08:10,614 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.log.path, /var/log/taskmanager/current
2020-01-15 14:08:10,614 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.exit-on-fatal-akka-error, true
2020-01-15 14:08:10,614 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.network.memory.max, 2147483648
2020-01-15 14:08:10,614 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.network.memory.fraction, 0.125
2020-01-15 14:08:10,614 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: web.upload.dir, /opt/flink
2020-01-15 14:08:10,614 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: akka.framesize, 20MB
2020-01-15 14:08:10,615 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: parallelism.default, 1
2020-01-15 14:08:10,615 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: state.backend, rocksdb
2020-01-15 14:08:10,615 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: state.checkpoints.num-retained, 4
2020-01-15 14:08:10,615 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: restart-strategy, fixed-delay
2020-01-15 14:08:10,615 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: restart-strategy.fixed-delay.delay, 0s
2020-01-15 14:08:10,615 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: restart-strategy.fixed-delay.attempts, 2147483647
2020-01-15 14:08:10,616 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.maxRegistrationDuration, Inf
2020-01-15 14:08:10,617 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: state.savepoints.dir, file:///checkpoints/flink/savepoints
2020-01-15 14:08:10,618 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.heap.size, 512000k
2020-01-15 14:08:10,618 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: taskmanager.numberOfTaskSlots, 2
2020-01-15 14:08:10,618 INFO  org.apache.flink.configuration.GlobalConfiguration            - Loading configuration property: jobmanager.rpc.address, wordcount-operator-example-cbb38a77
2020-01-15 14:08:10,754 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Starting StandaloneSessionClusterEntrypoint.
2020-01-15 14:08:10,755 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Install default filesystem.
2020-01-15 14:08:10,810 INFO  org.apache.flink.core.fs.FileSystem                           - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2020-01-15 14:08:10,828 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Install security context.
2020-01-15 14:08:10,840 INFO  org.apache.flink.runtime.security.modules.HadoopModuleFactory  - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2020-01-15 14:08:10,872 INFO  org.apache.flink.runtime.security.SecurityUtils               - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2020-01-15 14:08:10,873 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Initializing cluster services.
2020-01-15 14:08:11,363 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils         - Trying to start actor system at wordcount-operator-example-cbb38a77:6123
2020-01-15 14:08:11,873 INFO  akka.event.slf4j.Slf4jLogger                                  - Slf4jLogger started
2020-01-15 14:08:11,986 INFO  akka.remote.Remoting                                          - Starting remoting
2020-01-15 14:08:12,228 INFO  akka.remote.Remoting                                          - Remoting started; listening on addresses :[akka.tcp://flink@wordcount-operator-example-cbb38a77:6123]
2020-01-15 14:08:12,242 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils         - Actor system started at akka.tcp://flink@wordcount-operator-example-cbb38a77:6123
2020-01-15 14:08:12,258 INFO  org.apache.flink.configuration.Configuration                  - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-01-15 14:08:12,275 INFO  org.apache.flink.runtime.blob.BlobServer                      - Created BLOB server storage directory /tmp/blobStore-480d8ebb-3f65-427d-a62a-cdbe10dbb9ce
2020-01-15 14:08:12,284 INFO  org.apache.flink.runtime.blob.BlobServer                      - Started BLOB server at 0.0.0.0:6125 - max concurrent requests: 50 - max backlog: 1000
2020-01-15 14:08:12,310 INFO  org.apache.flink.runtime.metrics.MetricRegistryImpl           - No metrics reporter configured, no metrics will be exposed/reported.
2020-01-15 14:08:12,322 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Trying to start actor system at wordcount-operator-example-cbb38a77:50101
2020-01-15 14:08:12,357 INFO  akka.event.slf4j.Slf4jLogger                                  - Slf4jLogger started
2020-01-15 14:08:12,368 INFO  akka.remote.Remoting                                          - Starting remoting
2020-01-15 14:08:12,376 INFO  akka.remote.Remoting                                          - Remoting started; listening on addresses :[akka.tcp://flink-metrics@wordcount-operator-example-cbb38a77:50101]
2020-01-15 14:08:12,379 INFO  org.apache.flink.runtime.entrypoint.ClusterEntrypoint         - Actor system started at akka.tcp://flink-metrics@wordcount-operator-example-cbb38a77:50101
2020-01-15 14:08:12,388 INFO  org.apache.flink.runtime.dispatcher.FileArchivedExecutionGraphStore  - Initializing FileArchivedExecutionGraphStore: Storage directory /tmp/executionGraphStore-181c0f08-46d7-4e15-a32a-4b22a348ae33, expiration time 3600000, maximum cache size 52428800 bytes.
2020-01-15 14:08:12,457 INFO  org.apache.flink.runtime.blob.TransientBlobCache              - Created BLOB cache storage directory /tmp/blobStore-713da9d4-6742-4cd8-a78a-e27319f434f1
2020-01-15 14:08:12,486 INFO  org.apache.flink.configuration.Configuration                  - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2020-01-15 14:08:12,486 WARN  org.apache.flink.configuration.Configuration                  - Config uses deprecated configuration key 'jobmanager.web.port' instead of proper key 'rest.bind-port'
2020-01-15 14:08:12,490 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint    - Starting rest endpoint.
2020-01-15 14:08:12,745 WARN  org.apache.flink.runtime.webmonitor.WebMonitorUtils           - Log file environment variable 'log.file' is not set.
2020-01-15 14:08:12,745 WARN  org.apache.flink.configuration.Configuration                  - Config uses deprecated configuration key 'jobmanager.web.log.path' instead of proper key 'web.log.path'
2020-01-15 14:08:12,745 INFO  org.apache.flink.runtime.webmonitor.WebMonitorUtils           - Determined location of main cluster component log file: /var/log/jobmanager/current
2020-01-15 14:08:12,746 INFO  org.apache.flink.runtime.webmonitor.WebMonitorUtils           - Determined location of main cluster component stdout file: /var/log/jobmanager/currout
2020-01-15 14:08:12,764 WARN  org.apache.flink.configuration.Configuration                  - Config uses deprecated configuration key 'jobmanager.web.submit.enable' instead of proper key 'web.submit.enable'
2020-01-15 14:08:12,915 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint    - Rest endpoint listening at wordcount-operator-example-cbb38a77:8081
2020-01-15 14:08:12,916 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint    - http://wordcount-operator-example-cbb38a77:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
2020-01-15 14:08:12,916 INFO  org.apache.flink.runtime.dispatcher.DispatcherRestEndpoint    - Web frontend listening at http://wordcount-operator-example-cbb38a77:8081.
2020-01-15 14:08:13,015 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService              - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.StandaloneResourceManager at akka://flink/user/resourcemanager .
2020-01-15 14:08:13,036 INFO  org.apache.flink.runtime.rpc.akka.AkkaRpcService              - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/dispatcher .
2020-01-15 14:08:13,054 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager  - ResourceManager akka.tcp://flink@wordcount-operator-example-cbb38a77:6123/user/resourcemanager was granted leadership with fencing token 00000000000000000000000000000000
2020-01-15 14:08:13,056 INFO  org.apache.flink.runtime.resourcemanager.slotmanager.SlotManager  - Starting the SlotManager.
2020-01-15 14:08:13,072 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Dispatcher akka.tcp://flink@wordcount-operator-example-cbb38a77:6123/user/dispatcher was granted leadership with fencing token 00000000-0000-0000-0000-000000000000
2020-01-15 14:08:13,078 INFO  org.apache.flink.runtime.dispatcher.StandaloneDispatcher      - Recovering all persisted jobs.
2020-01-15 14:08:32,574 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager  - Registering TaskManager with ResourceID a38aabc3dbf8e15dddc933a20f7464ca (akka.tcp://[email protected]:33339/user/taskmanager_0) at ResourceManager
2020-01-15 14:08:32,784 INFO  org.apache.flink.runtime.resourcemanager.StandaloneResourceManager  - Registering TaskManager with ResourceID 26f79f7dbc197303d4d2b869dc39db9a (akka.tcp://[email protected]:43987/user/taskmanager_0) at ResourceManager
@tweise
Copy link
Contributor

tweise commented Jan 15, 2020

The logs indicate that you are using an older version of the example container, with Flink 1.8.2. The current version is 1.9.1. Can you please try to build the wordcount example from master?

@anandswaminathan
Copy link
Contributor

@anekdoti I believe this is the same issue as #160, can you check if you have the latest updated to the Flink Application Custom Resource Definition ?

@anekdoti
Copy link
Author

anekdoti commented Jan 17, 2020

Hello @anandswaminathan and @tweise , sorry for replying so late.

I removed every FlinkApplication custom resource and everything related to the flink-operator from my cluster. I then set up the flink-operator again with version v0.4.0, including the custom resource definition. The only deviation from the sources is that I set the resource requirements to 1 cpu and 1GB memory since I only have a very small cluster.

I am furthermore using the custom resource definition of the wordcount-operator-example from master with the latest sha tag and Flink 1.9.1.

However, the wordcount-operator-example job is still not started in the created Flink cluster.

flink-operator.log
wordcount-operator-example.log

kubectl describe FlinkApplication wordcount-operator-example -n team1 yields:

Name:         wordcount-operator-example                                                                                                    
Namespace:    team1                                                                                                                         
Labels:       environment=development                                                                                                       
              fluxcd.io/sync-gc-mark=sha256.SeVJimbi_kyPgzgGlBuaKO6nWNw-Q004mSFX0GBWIos                                                     
Annotations:  fluxcd.io/sync-checksum: fcebf28a22e1944dbf93d3bf40a630dd04a6235d                                                             
              kubectl.kubernetes.io/last-applied-configuration:                                                                             
                {"apiVersion":"flink.k8s.io/v1beta1","kind":"FlinkApplication","metadata":{"annotations":{"fluxcd.io/sync-checksum":"fcebf28
API Version:  flink.k8s.io/v1beta1                                                                                                          
Kind:         FlinkApplication                                                                                                              
Metadata:                                                                                                                                   
  Creation Timestamp:  2020-01-17T16:35:23Z                                                                                                 
  Generation:          1                                                                                                                    
  Resource Version:    10996465                                                                                                             
  Self Link:           /apis/flink.k8s.io/v1beta1/namespaces/team1/flinkapplications/wordcount-operator-example                             
  UID:                 6e56889f-6d1a-44c1-af84-40dcf9df2d72                                                                                 
Spec:                                                                                                                                       
  Delete Mode:  None                                                                                                                        
  Entry Class:  org.apache.flink.WordCount                                                                                                  
  Flink Config:                                                                                                                             
    State . Backend . Fs . Checkpointdir:       file:///checkpoints/flink/checkpoints                                                       
    State . Checkpoints . Dir:                  file:///checkpoints/flink/externalized-checkpoints                                          
    State . Savepoints . Dir:                   file:///checkpoints/flink/savepoints                                                        
    Taskmanager . Heap . Size:                  200                                                                                         
    Taskmanager . Network . Memory . Fraction:  0.1                                                                                         
    Taskmanager . Network . Memory . Min:       10m                                                                                         
    Web . Upload . Dir:                         /opt/flink                                                                                  
  Flink Version:                                1.9.1                                                                                       
  Image:                                        docker.io/lyft/wordcount-operator-example:e9054a414590b267178eefbe9331bd611863ff15          
  Jar Name:                                     wordcount-operator-example-1.0.0-SNAPSHOT.jar                                               
  Job Manager Config:                                                                                                                       
    Replicas:  1                                                                                                                            
    Resources:                                                                                                                              
      Requests:                                                                                                                             
        Cpu:     0.1                                                                                                                        
        Memory:  200Mi                                                                                                                      
  Parallelism:   3                                                                                                                          
  Task Manager Config:                                                                                                                      
    Resources:                                                                                                                              
      Requests:                                                                                                                             
        Cpu:     0.1                                                                                                                        
        Memory:  200Mi                                                                                                                      
    Task Slots:  2                                                                                                                          
Events:                                                                                                                                     
  Type    Reason           Age    From              Message                                                                                 
  ----    ------           ----   ----              -------                                                                                 
  Normal  CreatingCluster  5m48s  flinkK8sOperator  Creating Flink cluster for deploy c6538ec9                                              

I have the FlinkApplication in a namespace team1 separate from the flink-operator. Earlier, this did not make problems, but is it possible that it is a problem now?

@anandswaminathan
Copy link
Contributor

@anekdoti Can you try patching the fix #163, and see if it works?

@anekdoti
Copy link
Author

It works! Thank you very much!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants