Comments, reviews or critique are welcome, please just sent me an e-mail.

Journal, Conference or Book Chapter

2015 and upcoming

Choosing Basic-Level Concept Names using Visual and Language Context
Alexander Mathews, Lexing Xie, Xuming He
IEEE Winter Conference on Applications of Computer Vision (WACV), to appear, Jan 2015
abstract| pdf
Differential Topic Models
Changyou Chen,Wray Buntine, Nan Ding, Lexing Xie, and Lan Du
IEEE Trans. Pattern Analysis and Machine Intelligence (T-PAMI), Special Issue on Bayesian Non-Parametrics, accepted Mar 2014
abstract| pdf preprint

2014

Twitter-driven Youtube Views: Beyond Individual Influencers
Honglin Yu, Lexing Xie, Scott Sanner
ACM Conference on Multimedia (MM-14). Orlando, USA.
abstract| pdf
Social Collaborative Filtering for Cold-start Recommendations
S. Sedhain, S. Sanner, D. Braziunas, L. Xie, and J. Christensen
ACM Conference on Recommender Systems (RecSys-14). Silicon Valley, USA.
abstract| pdf
Content is Dead ... Long Live Content: The New Age of Multimedia-Hard Problems
Lexing Xie, David Ayman Shamma, Cees Snoek
IEEE MultiMedia, vol.21, no.1, pp.4,8, Jan-Mar 2014, doi: 10.1109/MMUL.2014.5
abstract| pdf
A Sketch-based Approach for Interactive Organization of Video Clips.
Yong-Jin Liu, Cui-Xia Ma, Qiu-Fang Fu, Xiaolan Fu, Sheng-Feng Qin, Lexing Xie
ACM Transactions on Multimedia Computing, Communications and Applications (ToMM), Vol. 11, No. 1, Article 2, 2014
abstract| pdf |demo video
Bilateral Correspondence Model for Words-and-Pictures Association in Multimedia-rich Microblogs
Zhiyu Wang, Peng Cui, Lexing Xie, Wenwu Zhu, Yong Rui, Shiqiang Yang
ACM Transactions on Multimedia Computing, Communications and Applications (ToMM), v10 n4, June 2014, doi: 10.1145/2611388
abstract| pdf

2013

Picture Tags and World Knowledge: Learning Tag Relations from Visual Semantic Sources
Lexing Xie, Xuming He
ACM Multimedia 2013, Oct 2013, Barcelona, Spain (full paper, acceptance rate 20%)
pdf| project page| slides
Social Affinity Filtering: Recommendation through Fine-grained Analysis of User Interactions and Activities
Suvash Sedhain, Scott Sanner, Lexing Xie, Riley Kidd, Khoi-Nguyen Tran, Peter Christen
ACM COSN 2013, Oct 2013, Boston, USA (full paper, acceptance rate 16%)
pdf| code
Tracking Large-Scale Video Remix in Real-World Events
Lexing Xie, Apostol Natsev, Xuming He, John Kender, Matthew Hill, John R Smith
IEEE Trans. Multimedia, vol 15 no 6, 1244-1254, Oct 2013. doi:10.1109/TMM.2013.2264929
abstract| open-access pdf | pdf
ActiveRaUL: A Web form-based User Interface to Create and Maintain RDF data. (2013)
Anila Sahar Butt, Armin Haller, Shepherd Liu, Lexing Xie
International Semantic Web Conference (Posters and Demos) 2013: 117-120
abstract| pdf| poster|
Improving LDA Topic Models for Microblogs via Automatic Tweet Labeling and Pooling. (2013)
R. Mehrotra, S. Sanner, W. Buntine, and L. Xie
Proceedings of the 36th ACM SIG Information Retrieval Conference (SIGIR-13). Dublin, Ireland, July 2013.
abstract | pdf | code
Scalable Mobile Video Retrieval with Sparse Projection Learning and Pseudo Label Mining (2013)
Guan-Long Wu, Yin-Hsi Kuo, Tzu-Hsuan Chiu, Winston H. Hsu, Lexing Xie
IEEE Multimedia, vol 20, no 3, pages 47 - 57, July-Sept. 2013, doi: 10.1109/MMUL.2013.13
abstract | pdf
Optimal Scaling Factor Assignment for Patchwise Image Retargeting (2013)
Yun Liang, Yong-Jin Liu, Xiaonan Luo, Lexing Xie, Xiaoming Fu
IEEE Computer Graphics and Applications, v33n5, pages 68-78, Sept-Oct 2013, doi: 10.1109/MCG.2012.123
abstract | pdf
Learning to Distribute Vocabulary Indexing for Scalable Visual Search (2013)
Rongrong Ji, Ling-Yu Duan, Jie Chen, Lexing Xie, Hongxun Yao, Wen Gao
IEEE Transactions on Multimedia 15(1): 153-166
link

2012

Social Event Detection with Interaction Graph Modeling (2012)
Yanxiang Wang, Hari Sundaram, Lexing Xie,
ACM Multimedia, 4 pages, Nara, Japan, October 2012
abstract |pdf
Multimedia Semantics: Interactions Between Content and Community (2012)
Hari Sundaram, Lexing Xie, Munmun De Choudhury, Yu-Ru Lin, Apostol Natsev
Proceedings of the IEEE, vol 100, issue 9, September 2012
abstract |pdf
Social Media Use by Government: From the Routine to the Critical (2012)
Andrea L. Kavanaugh, Edward A. Fox, Steven D. Sheetz, Seungwon Yang, Lin Tzy Li, Donald J. Shoemaker, Apostol Natsev, Lexing Xie
Government Information Quarterly, Volume 29, Issue 4, October 2012, Pages 480-491
abstract |pdf
Event Diffusion Patterns in Social Media (2012)
Minkyoung Kim, Lexing Xie, Peter Christen
Intl. Conf. on Weblogs and Social Media (ICWSM), 8 pages, Dublin, Ireland, June 2012
abstract |pdf
Media Lifecycle and Content Analysis in Social Media Communities (2012)
Lexing Xie, Hari Sundaram
IEEE Intl. Conf. on Multimedia and Expo (ICME), 6 pages, Melbourne, Australia, July 2012
abstract |pdf
New Objectives for Social Collaborative Filtering. (2012)
Joseph Noel, Scott Sanner, Khoi-Nguyen Tran, Peter Christen Lexing Xie, Edwin Bonilla, Ehsan Abbasnejad, Nicolas Della Penna.
21st International Conference on the World Wide Web (WWW-12), 10 pages, Lyon, France, April 2012
abstract |pdf | code | slides
ImageHive: Interactive Content-Aware Image Summarization (2012)
Li Tan, Yangqiu Song, Shixia Liu, Lexing Xie,
IEEE Computer Graphics and Applications, pp. 46-55, January/February, 2012
abstract |pdf
Semantic Model Vectors for Complex Video Event Recognition (2012)
Michele Merler, Bert Huang, Lexing Xie, Gang Hua, and Apostol Natsev
IEEE Trans. on Multimedia, v14 no. 1, page(s) 88-101, Feb. 2012
abstract |pdf |project page

2011

SCENT: Scalable Compressed Monitoring of Evolving Multirelational Social Networks (2011)
Yu-Ru Lin, K. Selçcuk Candan, Hari Sundaram, and Lexing Xie.
ACM Trans. Multimedia Comput. Commun. Appl. 7S, 1, Article 29 (November 2011), 22 pages.
abstract | pdf
Visual Memes in Social Media: Tracking Real-world News in YouTube Videos (2011)
Lexing Xie, Apostol Natsev, Matthew Hill, John Kender, John R Smith
ACM Multimedia 2011, Scottsdale, AZ, USA, Nov 2011
project page |pdf
Detect Irregularly Shaped Spatio-Temporal Clusters For Decision Support (2011)
W. Dong, X. Zhang, Z. Jiang, W. Sun, L. Xie, A. Hampapur
2011 IEEE International Conference on Service Operations and Logistics, and Informatics, July 10-12, 2011, Beijing, China.
link [best paper award]
Social media use by government: from the routine to the critical (2011)
A Kavanaugh, S. Sheetz, E. Fox, S. Yang, L.-T. Li, T. Whalen, D. Shoemaker, A. Natsev and L. Xie
ACM Digital Government Conference, College Park, MD, USA, June 2011
pdf
Tracking Visual Memes in Rich-media Social Communities (2011)
L. Xie, A. Natsev, M. Hill, J Kender, J. R Smith
Proc. AAAI Conference on Weblogs and Social Media (ICWSM), July 2011 (short version of the ACM MM paper)
project page |link |pdf
Analytics-driven Asset Management (2011)
A Hampapur, H Cao, A Davenport, WS Dong, D Fenhagen, RS Feris, G Goldszmidt, ZB Jiang, J Kalagnanam, T Kumar, H Li, X Liu, S Mahatma, S Pankanti, D Pelleg, W Sun, M Taylor, CH Tian, S Wasserkrug, L Xie, M Lodhi, C Kiely, K Butturff, L Desjardins
IBM Journal of Research and Development 55, page 1-13, Jan 2011
link

2010

Probabilistic Visual Concept Trees (2010)
Xie, L., Yan, R., Tešić, J., Natsev, A. & Smith, J.R.
Proceedings of the international conference on Multimedia ACM, 2010, pp. 867-870
abstract |pdf
Video Genetics: a Case Study from YouTube (2010).
Kender, J.R., Hill, M.L., Natsev, A., Smith, J.R., Xie, L.
MM '10: Proceedings of the international conference on Multimedia ACM, 2010, pp. 1253-1258
project page | abstract |pdf
The Accuracy and Value of Machine-Generated Image Tags: Design and User Evaluation of an End-To-End Image Tagging System (2010)
Xie, L., Natsev, A., Hill, M., Smith, J.R. & Phillips, A.
CIVR '10: Proceedings of the ACM International Conference on Image and Video Retrieval ACM, 2010, pp. 58-65
abstract |pdf
How Does the Data Sampling Strategy Impact the Discovery of Information Diffusion in Social Media? (2010).
M. De Choudhury, Y.-R. Lin, H. Sundaram, K. Selçuk Candan, L. Xie, A. Kelliher
ICWSM 2010, Fourth International AAAI Conference on Weblogs and Social Media, Washington DC, May 2010
abstract |pdf

2009

Visual Saliency with Side Information (2009)
W. Jiang, L. Xie, S.-F. Chang
ICASSP '09: Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing
IEEE Computer Society, 2009, pp. 1765-1768
abstract |pdf

2008

Event Mining in Multimedia Streams (2008)
L. Xie, H. Sundaram, M. Campbell
Proceedings of the IEEE, v96, no4, pages 623-647, April 2008
abstract |pdf
Fast Kernel Learning for Spatial Pyramid Matching (2008)
J. He, S.-F. Chang, L. Xie
Proc. IEEE International Conference on Computer Vision and Pattern Recognition - CVPR, Anchorage, Alaska, USA, June 2008.
abstract |pdf
Multi-concept Learning with Large-scale Multimedia Lexicon (2008)
L. Xie, R. Yan, J. Yang
Proc. IEEE International Conference on Image Processing - ICIP, San Diego, California, USA, October 2008.
pdf |poster
Extracting Semantics from Multimedia Content: Challenges and Solutions (2008)
L. Xie, R. Yan
Book Chapter, in Multimedia Content Analysis:Theory and Applications, A. Divakaran Ed., Springer, 2008.
booklink |pdf

2007

Semantic Concept-based Query Expansion and Re-ranking for Multimedia Retrieval (2007)
A. Natsev, A. Haubold, J Tešić, L. Xie, R. Yan
Proc. ACM Multimedia, pp. 991-1000, Augsburg, Germany, October 2007
abstract | pdf
Contextual Wisdom: Social Relations and Correlations for Multimedia Event Annotation (2007)
A. Zunjarwad, H. Sundaram, L. Xie
ACM-MM 2007: Proc. ACM Multimedia, Augsburg, Germany, October 2007 pp 615-624
abstract | pdf
Dynamic Multimodal Fusion in Video Search (2007)
L. Xie, A. Natsev, J. Tešić
Proc. IEEE Intl. Conf. on Multimedia and Expo (ICME) 2007, Beijing, China, July 2007.
abstract |pdf |slides
Data Modeling Strategies for Imbalanced Learning in Visual Search (2007)
J. Tešić, A. Natsev, L. Xie, J. R. Smith,
Proc. IEEE Intl. Conf. on Multimedia and Expo (ICME) 2007, Beijing, China, July 2007.
abstract |pdf |slides
Modeling Personal and Social Network Context for Event Annotation in Images(2007)
B. Shevade, H. Sundaram, L. Xie,
Proc. ACM/IEEE Joint Conf. on Digital Libraries (JCDL) 2007, June 2007, Vancouver, Canada.
abstract |pdf [best student paper award]
Exploiting Personal And Social Network Context For Event Annotation.
B. Shevade, H. Sundaram, L. Xie,
Proc. IEEE Intl. Conf. on Multimedia and Expo (ICME) 2007, Beijing, China, July 2007. (short version of the above)

2006

Detecting Generic Visual Events with Temporal Cues (2006)
L. Xie, D. Xu, S. Ebadollahi, K. Scheinberg, S.-F. Chang, J. R. Smith.
Proc. 40th Asilomar Conference on Signals, Systems, and Computers, Pacific Grove, CA, October 2006.
abstract |pdf
Pattern Mining In Visual Concept Streams(2006)
L. Xie, S.-F. Chang,
Proc. IEEE International Conference on Multimedia and Expo (ICME 06), Toronto, Canada, 2006.
abstract |pdf|slides
Visual Event Detection Using Multi-Dimensional Concept Dynamics(2006)
S. Ebadollahi, L. Xie, S.-F. Chang, J. R. Smith
Proc. IEEE International Conference on Multimedia and Expo (ICME 06), Toronto, Canada, 2006.
abstract |pdf

2005

T.-T. Ng, S.-F. Chang, Y.-F. Hsu, L. Xie, M.-P. Tsui. Physics-Motivated Features for Distinguishing Photographic Images and Computer Graphics. ACM Multimedia, Singapore, November 2005. (abstract | pdf) [best student paper award]
L. Xie, L. Kennedy, S.-F. Chang, A. Divakaran, H. Sun, C.-Y. Lin, Layered Dynamic Mixture Model for Pattern Discovery in Asynchronous Multi-modal Streams. Proc. International Conference on Acoustic, Speech and Signal Processing (ICASSP) 2005. (abstract | pdf)

2004 and earlier

L. Xie, L. Kennedy, S.-F. Chang, A. Divakaran, H. Sun, C.-Y. Lin, Discover meaningful multimedia patterns with audio-visual concepts and associated text. IEEE International Conference on Image Processing (ICIP), Singapore, October 2004. (abstract | pdf) [best student paper award]
L. Xie, P. Pérez, Slightly Supervised Learning of Part-Based Appearance Models. IEEE CVPR Workshop on Learning in Computer Vision and Pattern Recognition, Washington D. C, June 2004. (abstract | pdf)
L. Xie, P. Xu, S.-F. Chang, A. Divakaran, H. Sun Structure Analysis of Soccer Video with Domain Knowledge and Hidden Markov Models.. Pattern Recognition Letters, 25(7):767-775, May 2004 (abstract | pdf)
L. Xie, S.-F. Chang, A. Divakaran, H. Sun, Unsupervised Mining of Statistical Temporal Structures in Video. In Video Mining, A. Rosenfeld, D. Doremann, D. Dementhon (eds.), Chap. 10, Kluwer Academic Publishers, 2003. (abstract | pdf)
L. Xie, S.-F. Chang, A. Divakaran, H. Sun, Feature Selection for Unsupervised Discovery of Statistical Temporal Structures in Video. In IEEE International Conference on Image Processing (ICIP), Barcelona, Spain, September 2003. (abstract | pdf)
L. Xie, S.-F. Chang, A. Divakaran, H. Sun, Unsupervised Discovery of Multilevel Statistical Video Structures Using Hierarchical Hidden Markov Models. In IEEE International Conference on Multimedia and Expo (ICME), Baltimore, MD, July 2003. (abstract | pdf)
H. Sundaram, L. Xie, S.-F. Chang, A Utility Framework for the Automatic Generation of Audio-Visual Skims. ACM Multimedia, Juan Les Pins, France, December 2002. (abstract | pdf) [best student paper award]
L. Xie, S.-F. Chang, A. Divakaran, H. Sun, Structure Analysis of Soccer Video with Hidden Markov Models. In IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP-2002), Orlando, FL, May 2002 (abstract | pdf)
P. Xu, L. Xie, S.-F. Chang, A. Divakaran, A. Vetro, H. Sun, Algorithms and Systems for Segmentation and Structure Analysis in Soccer Video. In IEEE International Conference on Multimedia and Expo (ICME), Tokyo, Japan, August 2001. (abstract | pdf)
Thesis
L. Xie, Unsupervised Pattern Discovery for Multimedia Sequences. Graduate School of Arts and Sciences, Coumbia University, August 2005. (Abstract | pdf)
Notebook, Tech Report or Demo
Lexing Xie, Xuming He (2011)
Spatial Semantics and Classifier Cascades: The ANU 2011 Multimedia Event Detection System
Proc. TREC Video Retrieval Workshop, Gaithersburg, MD, December 2011 pdf
Yanxiang Wang, Lexing Xie, Hari Sundaram (2011)
Social Event Detection with Clustering and Filtering
Proc. MediaEval Workshop, Sept 2011 (superseded by the ACM MM'12 paper) pdf
A. Natsev, M. Hill, J. R. Smith, L. Xie, M. Merler, B Huang, M. Zhou, H. Ouyang, IBM Research TRECVID-2010 Video Copy Detection and Multimedia Event Detection System. Proc. TREC Video Retrieval Workshop, Gaithersburg, MD, November 2010 (pdf |slides)
A. Natsev, M. Hill, M. Merler, J. R. Smith, L. Xie, R. Yan, S. Bao, D. Wang, Y. Zhang, IBM Research TRECVID-2009 Video Retrieval System. Proc. TREC Video Retrieval Workshop, Gaithersburg, MD, November 2009 (pdf)
IBM multimedia analysis and retrieval system (2008) Natsev, A., Smith, J.R., Tešic, J., Xie, L. & Yan, R. CIVR '08: Proceedings of the 2008 international conference on Content-based image and video retrieval ACM, 2008, pp. 553-554
A. Natsev, W. Jiang, M. Merler, J. R. Smith, J. Tesic, L. Xie and R. Yan IBM Research TRECVID-2008 Video Retrieval System. Proc. TREC Video Retrieval Workshop, Gaithersburg, MD, November 2008 (pdf | slides)
L. Liu, L. Xie, D. J. Lan, P. N. Liu, R. Moulic, SpotSmart: A Mobile Shopping Assistant. ACM Mobicom 2008 Demo, San Franscisco, USA, Sept 2008 ((LINK)
M. Campbell, A. Haubold, M. Liu, A. Natsev, J.R. Smith, J. Tesic, L. Xie, R. Yan and J. Yang, IBM Research TRECVID-2007 Video Retrieval System. Proc. TREC Video Retrieval Workshop, Gaithersburg, MD, November 2007 (pdf)
M. Campbell, S. Ebadollahi, A. Haubold, D. Joshi, M. Naphade, A. Natsev, J. Seidl, J. R. Smith, K. Scheinberg, J. Tesic and L. Xie IBM Research TRECVID-2006 Video Retrieval System. Proc. TREC Video Retrieval Workshop, Gaithersburg, MD, November 2006 (pdf)
Shahram Ebadollahi, Lexing Xie, Andres Abreu, Mark Podlaseck, Shih-Fu Chang, John R. Smith, Exploring the Dynamics of Visual Events in the Multi-dimensional Semantic Concept Space. CIVR 2006:503-505 (LINK)
Y. Wang, L. Xie, S.-F. Chang, VisGenie: a Generic Video Visualization System.. Columbia University ADVENT Technical Report #210-2005-4, 2005. (abstract | pdf | PROJ PAGE)
S.-F. Chang, W. Hsu, L. Kennedy, L. Xie, A. Yanagawa, E. Zavesky, D.-Q. Zhang Columbia University TRECVID-2005 Video Search and High-Level Feature Extraction. Proc. TREC Video Retrieval Workshop, Gaithersburg, MD, November 2005. (pdf)
L. Xie, S.-F. Chang, A. Divakaran, H. Sun, Learning Hierarchical Hidden Markov Models for Video Structure Discovery. Advent Technical Report Columbia University, December 2002. (abstract | pdf)
L. Xie, K. Maeno, Q. Sun, C.-Y. Lin, S.-F. Chang. Benchmarking for SARI Image Authentication System. ADVENT Technical Report, Nov. 2002 Columbia University, November 2002. (abstract | pdf)
Patents
Structural Analysis of Videos with Hidden Markov Models and Dynamic Programming, US Patent No 6865226, March 2005. [at lens.org wipo/jp]
Unsupervised Learning of Video Structures Using Hierarchical Statistical Models to Detect Events, US Patent No 7313269, December 2007. [at lens.org, wipo/jp]
Method and Apparatus for Automatic Multimedia Narrative Enrichment, US Patent No 7818329, Issued October 2010 [at lens.org]
Method and Apparatus for Semantic Assisted Rating of Multimedia Content, US Patent No 8032539, Oct 2011 [at lens.org]
Multi-facet classification scheme for cataloging of information artifacts, US Patent Application, June 2010, Assignee: IBM [at lens.org]
Spatial-Temporal Optimization of Physical Asset Maintenance, US Patent Application, August 2010, Assignee: IBM [at lens.org, at google patents]
Visual Meme Tracking for Social Media Analysis, US Patent Application, October 2010, Assignee: IBM [at lens.org]
Video Genetics: Using near-duplicate video frames to analyze, classify, track, and visualize the evolution and fitness of videos, US Patent Application, Filed Aug 2010, Issued Aug 2014, Assignee: IBM [at lens.org, at google patents]
A System and Method for Failure Association Analysis, US Patent Application, Filed Dec 2010, Published Jul 2012, Assignee: IBM [at google patents]
Infrastructure Asset Management, US Patent Application, filed Jan 2011, publication date 2012, Assignee: IBM [at google patents]
Systems and methods for analyzing spatiotemporally ambiguous events, US Patent Application, filed Jun 2011, publication date Mar 2014, Assignee: IBM [at google patents]