Due to the increasing number of herbicide-resistant weed populations and the resulting yield losses, weed control must be given high priority to ensure food security. Integrated weed management (IWM) strategies, including reduced herbicide application, sensor-guided mechanical weed control and combinations thereof are indispensable to achieve this goal. Therefore, this study examined combinations of pre- and post-emergence herbicide applications with sensor-based harrowing and hoeing in cereals by conducting five field experiments at two locations in Southwestern Germany from 2019 to 2021. Each experiment contained an untreated control and a single post-emergence herbicide treatment as a comparison to these IWM treatments. The effects of the different IWM approaches on weed control efficacy (WCE), crop density, and grain yield were recorded. All experiments were set up in a randomized complete block design with four repetitions. Pre-emergence herbicide application combined with one-time harrowing and subsequent hoeing (Pre-Herb + Harr + Hoe) achieved the highest WCE (100%), followed by an approach of WCE (95%) for two-times hoeing. In contrast, a single pre-emergence herbicide application achieved the worst result with an average WCE of 25%. Grain yield was equal between all treatments in between 6 t ha−1 and 10 t ha−1, except for a single pre-emergence herbicide application, which achieved a 2.5 t ha−1 higher grain yield in winter wheat in 2021 that averaged 11 t ha−1, compared to the combination of Pre-Herb + Harr + Hoe that averaged 8.5 t ha−1. The results showed that it is possible to reduce and replace herbicides while achieving equivalent yield and WCE.