Multimodal Summarization of Data

  • Jagadesh Babu, T.Devi, N.Deepa


Customized content diagram is a focal NLP application that plans to accumulate a source content into a shorter structure. The brisk addition in intuitive media data transmission over the Internet requires multi-particular diagram (MMS) from non concurrent collections of substance, picture, sound and video. In this work, we propose an extractive MMS procedure that joins the strategies for NLP, talk getting ready and PC vision to explore the rich information contained in multi-secluded data and to improve the idea of MMS. The key idea is to associate the semantic openings between multi-secluded substance. For sound information, we plan an approach to manage explicitly use its interpretation and to induce the exceptional nature of the translation with sound sign. For visual information, we gain capability with the joint depictions of substance and pictures using a neural framework. By then, we get the incorporation of the made summary for critical visual information through substance picture planning or multi-secluded topic illustrating. Finally, all the multi-particular points are considered to create a printed overview by intensifying the striking nature, non-abundance, coherence and incorporation through the arranged upgrade of sub measured limits. We further present a straightforwardly available MMS corpus in English and Chinese. The preliminary outcomes show that our systems beat other forceful standard techniques

How to Cite
Jagadesh Babu, T.Devi, N.Deepa. (2020). Multimodal Summarization of Data. International Journal of Advanced Science and Technology, 29(7s), 4956 - 4960. Retrieved from