In this article, we propose the integration of a novel reinforcement learning technique into our generic and unified framework. This framework enables any continuous metaheuristic to operate in binary optimization, with the technique in question known as the Multi-Armed Bandit. Population-based metaheuristics comprise multiple individuals that cooperatively and globally explore the search space using their limited individual capabilities. Our framework allows these population-based metaheuristics to continue leveraging their original movements, designed for continuous optimization, once they are binary encoded. The generality of the framework has facilitated the instantiation of popular algorithms from the optimization, machine learning, and evolutionary computing communities. Furthermore, it permits the design of new and innovative optimization instances using various component strategies, reflecting the framework’s modularity. The results comparing two statistical techniques and three hybridizations coming from Machine Learning, have shown to obtain a better performance with the metahuristics in Grey Wolf Optimizer and Whale Optimization Algorithm.