With the conservation of power, a phase diagram defined by amplitude square and phase of scattering coefficients for each spherical harmonic channel is introduced as a universal map for any passive electromagnetic scatterers. Physically allowable solutions for scattering coefficients in this diagram clearly show power competitions among scattering and absorption. It also illustrates a variety of exotic scattering or absorption phenomena, from resonant scattering, invisible cloaking, to coherent perfect absorber. With electrically small core-shell scatterers as an example, we demonstrate a systematic method to design field-controllable structures based on the allowed trajectories in this diagram. The proposed phase diagram and inverse design can provide tools to design functional electromagnetic devices.