Salesforce runs a very large footprint of HBase and HDFS clusters in its data centers with multiple petabytes of data, billions of queries per day, and thousands of machines. After more than a decade of running its own data centers, Salesforce has started moving into public cloud. As part of this foray, we made a bold decision to move our HBase clusters from staid bare metal hosts in our data centers to the dynamic and immutable world of containers and Kubernetes. Along this journey, we had to wrestle with the issues created in HBase and HDFS by the changing network identities of containers, with ensuring service availability in the face of zone level failures in AWS, dealing with the limitations of Kubernetes when it comes to stateful applications and introducing encryption to secure big data traffic over untrusted public cloud networks. This is our story about how we overcame these challenges and factors that drove some of the choices we made.