The symbol screen can be used to pick a symbol that you wish to use for your guild icon. This icon is displayed on various guild related screens and may be used in conjunction with your guild color.
To pick a symbol simply click on the symbol you wish to use.