Artificial Intelligence (AI) has become a prevalent force in diverse medical domains, including image diagnostics, pathological categorization, treatment plan selection, and prognosis analysis. The collaboration between human and computer interactions has notably matured in the context of image-assisted cancer diagnosis. However, the ethical considerations associated with the incorporation of AI into clinical decision-making processes remain inadequately addressed. Consequently, the AI-driven Clinical Decision making System has not fully embraced interactions between humans and computers, particularly in the domain of image-supported diagnostic systems. This paper comprehensively reviews the global applications of the Clinical Decision Support System (CDSS) and delineates the fundamental principles guiding the incorporation of AI into CDSS. It scrutinizes the challenges faced by AI in oncology decision-making, shedding light on the existing ethical gaps. By presenting a thorough overview of the current landscape, this paper serves as a attribute framework for the future deployment of Artificial Intelligence in the field of oncology decision-making. As AI continues to progress, acknowledging and resolving ethical considerations becomes crucial for unlocking its full potential in enhancing clinical decision-making processes.