Solar pro implementation

[KareemMusleh]

Summary

implements #537

Details

I don't know if modeling_solar.py and configuration_solar.py are in the right place.

I also changed labels is not None to self.training and (labels is not None) in solar.py. To make it similar to how llama.py is written.

Testing Done

• Hardware Type: NVIDIA GeForce MX230
• run make test to ensure correctness
• run make checkstyle to ensure code style
• run make test-convergence to ensure convergence
• write new tests

[KareemMusleh]

what other tests should I add?

[vaibhavjindal]

what other tests should I add?

Please add fp16 and fp32 convergence tests as well.
See #685 and #692

[KareemMusleh]

@vaibhavjindal done! I don't have the hardware to test it but I think it should work.