In Layout Builder it adds a textbox to the Section configure form where you can add your own classes.
Setting the classes won't be enough. You need to make sure that the layout (that you chose for the section) uses the {{ attributes }} variable in its template. Because that variable contains the specified classes. An example for the variable usage is in Drupal core's layout--onecol.html.twig: