Filters








40,887 Hits in 5.9 sec

Focus Attention: Promoting Faithfulness and Diversity in Summarization

Rahul Aralikatte, Shashi Narayan, Joshua Maynez, Sascha Rothe, Ryan McDonald
2021 Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)   unpublished
When evaluated on the BBC extreme summarization task, two state-of-the-art models augmented with Focus Attention generate summaries that are closer to the target and more faithful to their input documents  ...  We also empirically demonstrate that Focus Sampling is more effective in generating diverse and faithful summaries than top-k or nucleus samplingbased decoding methods. . 2020. Go figure!  ...  Focus Sampling: Promoting Diversity in Faithful Generation We introduce Focus Sampling with FAME to construct a subset V k ⊆ V by sampling k tokens from the topic distribution t X (Focus sample,k ).  ... 
doi:10.18653/v1/2021.acl-long.474 fatcat:l75amy3fcbchnghnjp7ayh3wgq

Efficient Attentions for Long Document Summarization [article]

Luyang Huang, Shuyang Cao, Nikolaus Parulian, Heng Ji, Lu Wang
2021 arXiv   pre-print
The quadratic computational and memory complexities of large Transformers have limited their scalability for long document summarization.  ...  In this paper, we propose Hepos, a novel efficient encoder-decoder attention with head-wise positional strides to effectively pinpoint salient information from the source.  ...  Acknowledgements This research is supported in part by Oracle for Research Cloud Credits, National Science Foundation through Grant IIS-1813341, and by the Office of the Director of National Intelligence  ... 
arXiv:2104.02112v2 fatcat:g5z6bpbqu5eutd3ujc5xm4mc3m

Multi-Document Summarization with Determinantal Point Process Attention

Laura Perez-Beltrachini, Mirella Lapata
2021 The Journal of Artificial Intelligence Research  
In this work, we propose an attention mechanism which encourages greater focus on relevance and diversity.  ...  The ability to convey relevant and diverse information is critical in multi-document summarization and yet remains elusive for neural seq-to-seq models whose outputs are often redundant and fail to correctly  ...  From Table 7 we can see that the DPP attention focuses on fewer input spans but with higher diversity.  ... 
doi:10.1613/jair.1.12522 fatcat:vdqhcpgxobcn5eehsft3pidx5y

Focus on IFLA

Stephen Parker
2009 IFLA Journal  
Acknowledgments The author gratefully acknowledges her mentors in the library and information science fi eld, Tovah Reis, Catherine Dibble and Dr.  ...  Acknowledgements This study was fi nanced with funds provided by the Guust van Wesemael Literacy Prize, awarded by IFLA to the National Book Trust of Uganda in 2007.  ...  In the higher education literature, mentoring has received attention and mentoring activities are reported to be more focused on career functions, rather than on psychosocial activities.  ... 
doi:10.1177/0340035209105664 fatcat:xymg3rb5pffd5lciuka72pghra

Attention, please! A survey of Neural Attention Models in Deep Learning [article]

Alana de Santana Correia, Esther Luna Colombini
2021 arXiv   pre-print
Given our limited ability to process competing sources, attention mechanisms select, modulate, and focus on the information most relevant to behavior.  ...  In humans, Attention is a core property of all perceptual and cognitive operations.  ...  However, if the focus is a faithful and accurate interpretation of the link that the model establishes between inputs and outputs, results are not always positive.  ... 
arXiv:2103.16775v1 fatcat:lwkw42lrircorkymykpgdmlbwq

Cross-Attention in Coupled Unmixing Nets for Unsupervised Hyperspectral Super-Resolution [article]

Jing Yao, Danfeng Hong, Jocelyn Chanussot, Deyu Meng, Xiaoxiang Zhu, Zongben Xu
2020 arXiv   pre-print
Moreover, a cross-attention module is devised to yield more effective spatial-spectral information transfer in networks.  ...  Extensive experiments are conducted on three widely-used HS-MS datasets in comparison with state-of-the-art HSI-SR models, demonstrating the superiority of the CUCaNet in the HSI-SR application.  ...  First, we compute the spatial and spectral attention from the branch of LrHSI and HrMSI, since they can provide with more faithful spatial and spectral guidance.  ... 
arXiv:2007.05230v3 fatcat:5sdnosszwfdf5jfgduwyylfua4

Focus on Québec

Stephen Parker
2008 IFLA Journal  
However, as unfortunate as it is, the lack of focused attention is converting a schism into a gulf.  ...  The proceedings are summarized in the report on the session by Christel Mahnke.  ...  He received the degree for the exceptional leadership role he played in the LIS profession in South Africa and internationally and for his outstanding research contributions to this fi eld.  ... 
doi:10.1177/0340035208099260 fatcat:7s6kydmkxnhdrje4d2o2c3ohui

Spiritual Formation of Senior Adults: Ministry Focus of Church and Synagogue

Connie Beran
2010 Journal of Religion Spirituality & Aging  
ACKNOWLEDGEMENTS I would like to thank Bellevue Christian Church for providing me with the time and the financial support to write this project and to pursue my Doctor of Ministry degree.  ...  Stone attempts to summarize some of the core beliefs of the movement, the most important being faith in Christ alone.  ...  any attempt to summarize any common set of actual beliefs that could be found in any formal statement of faith, or be considered a condition of membership.  ... 
doi:10.1080/15528030903313854 fatcat:yiajxurrkfaszcqkyvbx2j2f2q

What Most Needs the Attention of Religion Researchers in the Twenty-First Century? [chapter]

2000 Research in the Social Scientific Study of Religion, Volume 11  
Seven challenges for attention in the social sciences of religion are summarized: renewed attention to the metasociological foundations of research, building upon past findings, caution in the use of modern  ...  Work on these and on public relations issues can return religious research and theory to the place of prominence it deserves in the social sciences.  ...  ACKNOWLEDGMENT This paper is an elaboration of a presentation in a session on "Passing the Torch" in the annual meeting of the Association for the Sociology of Religion in San Francisco, August 22, 1998  ... 
doi:10.1163/9789004493278_003 fatcat:edl6yluwpbfdtp65fatbzbm55i

Our Lives Were Healthier Before: Focus Groups With African American, American Indian, Hispanic/Latino, and Hmong People With Diabetes

Heather Devlin, Martha Roberts, Amy Okaya, Yer Moua Xiong
2006 Health Promotion Practice  
Focus groups were conducted to explore health-related beliefs and experiences of African American, Hispanic/ Latino, American Indian, and Hmong people with diabetes and engage community members in improving  ...  Eighty participants attended 12 focus groups, 3 per population.  ...  Given finite resources, how can we broadly and effectively address diabetes in diverse populations?  ... 
doi:10.1177/1524839905275395 pmid:16410420 fatcat:bacn2acczzhhjj5mhhamndgd2y

Healthy aging through the lens of community-based practitioners: a focus group study

Rubee Dev, Oleg Zaslavsky, Barbara Cochrane, Thomas Eagen, Nancy F. Woods
2020 BMC Geriatrics  
one of three in-depth focus group discussions conducted between March and June 2016.  ...  The rapidly changing demographics and aging population in the United States and their various needs suggest the implications for recognizing opportunities and developing and implementing programs to promote  ...  Acknowledgments The authors would like to thank all the community-based practitioners who participated in the focus group discussion. Authors' contributions  ... 
doi:10.1186/s12877-020-01611-x pmid:32539780 pmcid:PMC7296747 fatcat:6bvfhijg75gsji7gudmef53mja

Toward Practical Usage of the Attention Mechanism as a Tool for Interpretability

Martin Tutek, Jan Snajder
2022 IEEE Access  
In this article, we present a study that extends the techniques for improving faithfulness of attention based on regularization methods which promote retention of word-level information.  ...  We find that incorporating tying regularization consistently improves both the faithfulness and plausibility of explanations obtained through inspecting attention weights across analyzed datasets and models  ...  Finally, in Section V we summarize our findings and propose directions for future work. II.  ... 
doi:10.1109/access.2022.3169772 fatcat:znagngkhzratngwbre6rfujjau

Meanings Given to Professional Care: Focus Group Results

Mary Kalfoss, Jenny Owe Cand Scient
2017 Open Journal of Nursing  
Many studies have focused on exploring the concept of care from patient and nurse perspectives, but knowledge is limited regarding student perceptions.  ...  in education, clinical practice, administration and research.  ...  At the closure of the focus groups, the moderator summarized the main points of the discussion, in order to verify the accuracy of the information discussed.  ... 
doi:10.4236/ojn.2017.75041 fatcat:ldbfqo4dozaxdmgi7tynlzrzky

Acculturation and Self-Regulation as Determinants of Childhood Obesity

Regine Talleyrand, Anastasia Kitsantas
2010 Focus on exceptional children  
Given the lack of attention given to these constructs, using interviews and focus groups with racially and ethnically diverse participants would allow us to gather themes and constructs of interest.  ...  Nonetheless, additional studies focused on identifying specific patterns of acculturation are important for delineating groups at risk for engagin-g in obesity-promoting behaviors.  ...  The book covers the historical relationship between spirituality and counseling, theories of faith development and spirituality, methods for working with clients' diverse beliefs, spiritual assessment  ... 
doi:10.17161/foec.v42i6.6694 fatcat:murk6t5535dfbas3ioljflgcsq

Acculturation and Self-Regulation as Determinants of Childhood Obesity

Regine Talleyrand, Anastasia Kitsantas
2010 Focus on exceptional children  
Given the lack of attention given to these constructs, using interviews and focus groups with racially and ethnically diverse participants would allow us to gather themes and constructs of interest.  ...  Nonetheless, additional studies focused on identifying specific patterns of acculturation are important for delineating groups at risk for engagin-g in obesity-promoting behaviors.  ...  The book covers the historical relationship between spirituality and counseling, theories of faith development and spirituality, methods for working with clients' diverse beliefs, spiritual assessment  ... 
doi:10.17161/fec.v42i6.6694 fatcat:6zaaoxls6jhpjkhxpj5efymxfe
« Previous Showing results 1 — 15 out of 40,887 results