The widespread application of artificial intelligence is transforming human society into a man-machine symbiosis society. The present paper discusses the development trend and characteristics of the social system with man-machine symbiosis, and analyzes the challenges that need to be faced in the development of man-machine collaboration and symbiosis. From the aspects of safety, controllability, interpretability, trustworthiness and ethical adaptability, this article puts forward a regulatory framework for the development of artificial intelligence in the intelligent society with human-machine integration.