Practical tips for questionnaire design


When faced with measuring social benefits, the easiest way is to use questionnaire surveys. We only need to pay attention to the following principles, and we don’t have to write too casually and worry that the data asked are not persuasive.


First of all, you should first think about the results you expect. For example, in which aspects will the recipients change, do you feel happy? Is it improved knowledge or skills? Is there a change in attitude or behavior? What kind of behavior is it? Is it too polite to nod? Or lack of rude performance? Talk to others too much? Is to concentrate and so on. As long as you are clear about what you want to measure, you can reduce the length of the question to ask some data that will not be used in the future.


Second, each type of change, that is, mentality, knowledge, skills, or behavior, should be asked by its own questions, ensuring that a small number of questions cover each type of unique change. The questionnaire produced in this way is simpler and the audience has a higher chance to answer the entire questionnaire accurately.


Third, as long as the scoring ratio of the problem design is the simplest one to five (or one to seven), the best method is to use the most common and most popular method in textbooks, so that the result is the easiest to analyze and make Stakeholders should understand, don't give up easy and difficult, so that you will have to spend more time in the future to explain clearly. Generally speaking, using singular scores can make people answer middle or neutral, and in the analysis, let us know how to turn the neutral masses into more identity, which brings important information for improving the benefits of the project.


Fourth, try to use a uniform scoring ratio. The first is to facilitate analysis and reduce administrative costs, and second, to reduce the audience’s errors in answering. But if the ratio used in the past questionnaire design is not the commonly used one to five, we can still formulate it into different ratios. This is just a problem of mathematical calculations, and it can be solved only by teaching people. Don't worry, past data will not be wasted.


Fifth, the length of the questionnaire should not exceed two pages, making the audience too strenuous, and asking the right questions is the most important thing.


Sixth, do it yourself after completing the questionnaire to see if the words are clear and straightforward, and then boldly estimate what score the audience will get after answering. This mentality of estimation is to cultivate one's own confidence in the effect of project implementation, urge oneself to have better control, so that the long-term benefits of the project can be further improved.


Of course, questionnaire design can be a specialized subject, but this does not mean that everyone must first take a professional course to make a good questionnaire. In many cases, the simplest, most direct, and easy-to-understand questionnaire is a good questionnaire, and the results obtained are often the most reliable. Therefore, we should not care whether it is a perfect questionnaire, but should pay attention to whether the audience is easy to answer. In addition, we will do more repeatedly and do it over the new year to let ourselves know whether the project is getting better and better, so that it can better reflect our original intention of doing social welfare projects and doing benefit measurement.


Ted Kwan

Chief Mentor and Chartered Financial Analyst



#Questionnaire Design#Social BenefitMeasurement#Data#社福


Social Benefit Measurement@艺术Project


For many years, Hong Kong has used economic development as the main theme, and art as a spiritual aspect is difficult to become mainstream in Hong Kong people's lives, let alone artistic creativity and appreciation. Although art is "so far", it is "so close". A few years ago, a digital version of the “Surfing the River on the Ching Ming Festival” was exhibited in the exhibition hall of a government department. At that time, there was a scene of empty streets. It can be said that art is not completely isolated from the lives of ordinary citizens. What exactly is art? This article is limited in space and fails to discuss the essence of art in depth; however, generally speaking, art is a kind of emotional communication. It can be said that the author expresses a certain emotion in his artistic creation, and the viewer is appreciating the work. Time can also receive the same emotions, and art resonates among them; there is a saying that art has no fixed function, and it is given different meanings in different time and space. Although the above is only a preliminary discussion, it may be enough to explain why the average person feels that the effects of art seem to be unavailable.


The problem now is that, with the funding support of government departments or the sponsorship of private enterprises, many art institutions in Hong Kong have organized projects for the general public; the concrete presentation of the effects of the projects is beneficial to all sectors of society. Understand the specific meaning of the art project, and objectively prove that the funding or sponsorship of the relevant department for the project is properly used.


The social benefit measurement helps to present the seemingly or not-to-be-obtained effects of general art projects as clearly visible effects.

Last year, the Asia Society Hong Kong Center held the "Root of Vientiane: Zhou Luyun's Painting Art Exhibition", which showcased the changes in personal emotions through abstract paintings combining Zen and Taoism, and through Ms. Zhou's reputation and the "down-to-earth" mental health issues. It is hoped that it can inspire the public to integrate artistic creation into daily life. Relevant project teams participated in the "Jockey Club Plenty Social Benefit Measurement Training Program", and based on the Kirkpatrick Model's first three levels to set benefit indicators and design questionnaires for benefit research:


1. At the affective level (the first level), one of the indicators is the degree to which participants enjoy art activities. The survey results show that 80% of respondents said they enjoy activities, which means that they have a strong motivation to engage in art-related activities in their daily lives. activity;

2. As for the cognitive level (the second level), one of the effectiveness indicators is whether the participants feel the pressure is relieved after completing the activity. The survey results show that 87% of the interviewees strongly agree with the decompression effect of art activities, and the remaining 13% Agree with this, none of the interviewees expressed neutrality or disagreement;

3. At the level of behavior transformation (the third level), one of the indicators is whether participants will continue to participate in other art activities (including creation at home) in order to achieve the purpose of integrating art into daily activities. The survey results show all (100%) Interviewees indicated that they will continue to participate in art activities.


The above social benefit measurement methods simply and directly present the effectiveness of the project, and the extra effort required is just to make a simple questionnaire, distribute, collect and analyze the questionnaire.


Samuel Lee



#Society-Efficiency Measurement#Art#Three-tier transformation

Three-tiered description of the transition



Most of the social welfare projects are "people-oriented", meaning that they hope to help others "improve" through activities, contacts, consultations, etc.


That being the case, the most direct way to effectively demonstrate the effectiveness of the project, or the easiest way to make people understand it, is to state the changes of the recipients.


It was not the social welfare sector, but the business world that first proposed to describe people with three levels. In 1954, at the time, Donald Krikpatrick of the University of Wisconsin studied the effectiveness of its training under the prerequisite of company training. What kind of results can he get back with the cost of training? He believes that three dimensions should be used to describe the performance of employees. The first level is direct response, the second is what knowledge, skills and attitudes have been learned, and the third is the conversion of what has been learned into behavior. The author borrowed this concept and used it in social welfare projects, and found the effect was good. It is not only easy to understand, but also enables oneself to have a deeper understanding of the project.


1) Subjective direct reaction or feeling


For a good project, its participants must at least like the overall satisfaction of the project, and secondly, be willing to introduce it to others. These two are the most basic. For different situations,


The recipient’s other subjective feelings should also be measured, such as happiness, feeling hesitant, trusting in others, feeling supportive, etc. These are all subjective statements that can be clearly measured with questions or interviews.


2) Knowledge, skills and attitude


Many projects are aimed at increasing the abilities of the recipients, such as vocational training, learning to deal with interpersonal relationships, conflicts, mastery of language, or attitudes towards minorities, perceptions of family members, and so on. These are the changes on the second level.


Three) Behavior change


Many social problems are related to behavior, such as smoking, self-harm, healthy eating, being polite, using less plastic bags, and so on. If the behavior of the beneficiaries of the social welfare guess is changed, the effect will be more obvious. Therefore, a good metric that can describe changes in behavior is the easiest way for stakeholders to understand, understand and continue to support this social welfare project.


The author’s observation is that most social welfare projects in Hong Kong have formal questionnaires, but unfortunately they are a bit lengthy but not scratchy. If you pay more attention to the question design, make sure that the question summarizes the three-level description. It's a large space, but it can be clear to the stakeholders during the project roadshow. This is the most ideal!


Ted Kwan

Chief Mentor and Chartered Financial Analyst


#三层变#subjective feelings#Knowledge Skills and Attitudes#Behave Change#Social BenefitMeasure#社福#DonaldKrikpartrick #DKmodel


What does sustainability do to me?



In the past half century, the international community has been discussing sustainable development uninterruptedly, all because the current lifestyle of all human beings cannot be sustained. As a supranational institution, the United Nations has proposed a way of life that strikes a balance between economic development, social development, and environmental protection, so that people living in the present and future generations can lead a quality life. After years of international multilateral negotiations and policy deliberations, despite the ups and downs in the process, the United Nations finally reached a consensus on the global development direction in 2015 --- 17 Sustainable Development Goals (Sustainable Development Goals). A detailed description of these 17 goals can be found on the official website of the United Nations, so I won’t repeat them here. This article aims to explore the significance of these 17 goals for general non-governmental organizations in this city.


First of all, both international and local business communities have begun to attach importance to these 17 goals; a survey report published by PricewaterhouseCoopers in 2019 showed that 72% of the 1,141 interviewed companies from 31 countries and different industries included in their report. When it comes to the Sustainable Development Goals, 25% of companies incorporate the Sustainable Development Goals into their business strategies, and 21% of the company’s CEOs mentioned the Sustainable Development Goals in their published articles or speeches. 14% of the companies have published specific indicators for achieving the relevant sustainable development goals; as for Hong Kong, according to a survey by Alava Consulting, only 6% of the listed companies in Hong Kong used environmental, social and governance reports in 2017 The Sustainable Development Goals are used to illustrate the social responsibilities they have fulfilled. In 2018, listed companies that did the same thing accounted for 18% of all parent companies, which was three times that of the previous year, reflecting the Sustainable Development Goals as a measure and description of the international and local business community. The tool of its social responsibility has become an irreversible trend.



On the other hand, in order to fulfill their social responsibilities more comprehensively, many commercial enterprises will choose to fund non-governmental organization projects. If non-governmental organizations use relevant sustainable development goals as a tool to measure and describe their social benefits, in the long run, they can establish a common language with the business community, which will help non-governmental organizations to collect donations from individual companies.



However, some people in the social welfare community have informally shared their views on the Sustainable Development Goals. They feel that the Sustainable Development Goals are not relevant to their ministry, because they think these goals focus on the international dimension. What they do is to respond to the needs of the local society. If you have the opportunity to look closely at the technical details of the Sustainable Development Goals, you will find that these perceptions do not match the facts. In fact, the United Nations has established these goals with intentions. It is to encourage all government departments, business enterprises, and civil society around the world to work locally to promote sustainable development. It can be said that institutions and people all over the world are the targets. Take the youth trial work program of a local social welfare organization as an example. It serves a group of out-of-school and unemployed young people. The program provides them with trial work experience, helps them strengthen their work skills and understand their employment orientation; in fact, the project The plan coincides with the 8th Sustainable Development Goal (Decent Work and Economic Growth), all because helping the youth who have lost their jobs help promote more inclusive economic development. As for how to determine technically that the plan responds to the eighth sustainable development goal? Let us continue the discussion in the next article.


Samuel Lee



#SDG # Sustainable Development#SustainableDevelopmentGoals #社福


The fourth layer-see benefits from the project sponsor



Those who are engaged in social welfare have their professional backgrounds and have a deep understanding of the problems faced by the project beneficiaries. It is reasonable and reasonable to devote their energy and time to the beneficiaries’ benefits. They should expect the beneficiaries to be in their hearts and minds There are positive changes in knowledge, skills or attitudes, and even behaviors. This is the measurement of the three levels of change advocated by Fengsheng.


Today’s project sponsors, in addition to hoping to provide financial support, their donations are also increasing, and they are also moving towards a professional path. We should be happy to see that besides the government, there are more family funds, companies, community funds, Specific public funds to participate in building a better society. The trend of specialization will inevitably bring greater accountability requirements, and colleagues in the fund must also explain their donated projects. Fullshare proposes that sponsors can use four methods to measure the cost-effectiveness of the project.


Social return on investment


The most ideal of course is to compare the social investment return of the project. Taking the existing cases in the world, there can be a return of 3-4 times, that is, the social benefits brought by a one-yuan subsidy. If quantified by money, it can be There is a return of three or four times or more. The key is to have an open and acceptable method to quantify social benefits. Some people in foreign countries try to promote it but it is still unsatisfactory. Because the rationale is more technical, the author will write another article. Explore the methods and difficulties in it.


If the return cannot be calculated, we still have a way to make reasonable judgments. First, we can calculate the subsidy required by each beneficiary in the project, that is, the unit cost.


Apple to apple


Starting from the unit cost, you can first find out the relevant benchmark (Benchmark), as long as there is a comparison of the unit costs of similar social welfare projects, you can get a little bit of one or two. One student spends 800 yuan for the other. Just look at the detailed items in the budget to find out whether it is reasonable. The author understands that each item has different focuses, such as different regions, high school and junior high school students, and the holding format is also acceptable. It is different, but this comparison gives sponsors the opportunity to learn more, find out the effective parts to keep, and improve the low-efficiency parts to make their sponsorship more effective in the long run.


Apple vs. Aomori Apple


The second is to find similar items (Comparable) to compare. Similar means similar. For example, for a project to train young people’s leadership skills, we can refer to the cost of young people taking time management courses, or use adults Comparing the cost of leadership training, the similarity is that the same is spent on young people, or the same is related to leadership training.


Apple to orange


The third is to use similar concepts (Reference) to compare. For example, it is also to train the leadership skills of middle school students. There is no similar project in the market. We can refer to the unit cost of adult management courses or the cost of communication skills training for college students. Suppose a college student needs 3,000 yuan to learn communication, and the leadership training for middle school students costs 6,000 yuan. This still gives the sponsor a room to ask if 6,000 yuan is reasonable? The two to be compared do not have the same elements. , But this can still be measured, just like in the family, we all know that it is better to buy a tablet or to go on a 4-day and 3-night trip is more effective.


in conclusion


There are no two exactly the same things in the world, but they do not necessarily hinder comparison. You only need to have the right amount of creativity to find similar things. The social welfare business is people-oriented, and people are indeed complex and multi-faceted, so we should stimulate creativity, let stakeholders understand the effectiveness and benefits of the project, and strive for more support to create a better society.


The above is to propose a hierarchical framework to provide guidelines for friends who are engaged in social impact measurement (Social Impact Measurement) for reference. There is no limit to learning. I hope that more friends in the social welfare circle will try to use it and give back their opinions, and let the author know this Whether the level is "landed".


Ted Kwan

Chief Mentor and Chartered Financial Analyst


#Social Investment Return#Social BenefitMeasurement#SocialImpactMeasurement


Practical research in social benefit evaluation



The social benefit measurement method promoted by the Association is an Evidence-based Research method. We use this method to measure the effectiveness of the project, so we know the size of the various effects of the project so that we can report to different stakeholders (including institutions). Supervisors, project sponsors and members of the public, etc.) demonstrate the results of the project. Many years ago, Canada had a very successful inmate education program (Simon Fraser Prison Education Programme). Some audiences accepted that the researcher (Duguid, 2000) did not share too much of the course content during the interview, but shared a lot of the inner transformation triggered by the plan. One of the inmates confirmed his interest and future development that he was actively involved in In the direction, another person in custody said that the plan provides a function of education, allowing the person to correct past wrong behaviors in a subtle process; the above-mentioned audience sharing is part of the qualitative data obtained from evidence-based research.


After completing the evidence-based research, we may need to further investigate the reasons for these effects. The reason is that if we have the opportunity to implement the same or similar projects again, we must ensure that these winning factors reappear before we can be sure that the project can be manufactured again. Expected results. The work of finding the cause is called “Practice Research”; the paradox is that even if we are very familiar with the operation of the project, sometimes the reason for the project’s effectiveness is usually not obvious, because it is in the process of receiving intervention services. , There may be subtle interactions between audiences, and even between audiences and the scene they are in. Taking the above-mentioned inmate education plan as an example, the researcher further analyzed various data based on evidence-based research and found that there are several aspects of the generation mechanism that led to the success of the plan: 1) The plan avoids "renewal", "counseling", "correction", etc. Labeled words as the main theme; 2) try to give the prisoners their autonomy as much as possible (for example, give them the right to freely participate and withdraw; for example, the planned classes are concentrated in one building, where the participants monitor themselves and participate separately When they mature, they can be called course instructors), and guide them to be the subject of self-control. When their sense of autonomy is restored, they are responsible for their own development, so they are provided with appropriate guidance so that they can establish a foundation for long-term development. ; 3) Their autonomy is improved to help establish a civilized atmosphere; 4) Finally, to show their recognition of them, Simon Fraser University will award them a degree or diploma. Undoubtedly, these four findings are very valuable reference knowledge for organizations that will implement related projects in the future.


Due to the word limit, this article can only give a brief introduction to practical research. But in a nutshell, practical research helps us to generate new knowledge about project design, implementation, and effectiveness, and this knowledge becomes the basis for us to implement the next related project. Will practical research be the path towards social benefit assessment 2.0? This issue is worthy of our continued discussion.



DUGUID, S. (2000).  Can Prisons Work?: The Prisoner as Object and Subject in Modern Corrections. Toronto; Buffalo; London: University of Toronto Press. Retrieved August 1, 2020, from www.jstor.org/stable/10.3138/9781442671676


Pawson, R. (2013).  The science of evaluation: A realist manifesto. London,: SAGE Publications Ltd doi: 10.4135/9781473913820

Samuel Lee




The importance of speaking clearly



To show the effectiveness of social welfare projects, Fengsheng proposes three perspectives to measure the changes in the audience, namely, the first is the change in the mind and subjective feelings, the second is the mastery of knowledge, skills and attitudes, and the third is the change in the behavior of the recipients. This article thinks Pointing out that at a practical level, what stakeholders most expect to see is behavioral changes. For example, to promote healthy diets for the elderly, education can be used to enable audiences to acquire knowledge, and they can also change their prejudice against healthy foods, etc. But for the audience’s family or other stakeholders, one of the most powerful indicators is what the audience has eaten every day.


The author understands that the goals and priorities of each social welfare project will be different. For example, if the project is only engaged in public education, then the transfer of knowledge is the focus, not behavior change. For the person to be evaluated, the most important thing for the author is to be able to explain clearly. If the focus of the project is education, the author will compare the unit cost of holding education. For example, the training of workplace learning will cost about 1,000 yuan per person. One day's cost.


For another example, the project is mainly to encourage daily exercise. The author will treat the knowledge part of the teaching as a general knowledge promotion. The unit cost may be only a few hundred yuan to make one person understand, but it must be constant every week. The unit cost of doing sports is much higher. As long as people spend hundreds of yuan an hour to hire a personal trainer, the monthly expenditure can be two to three thousand yuan.


Therefore, the author encourages social welfare colleagues to clarify the specific benefits, whether it is for behavior or knowledge changes, and the cost can vary by several times or more. In addition, what percentage of the project’s audience is showing deeper behavior changes. For example, one hundred of a thousand participants will follow up their behavior in depth, and the cost will be higher. If you split it out, you can make the support Participants more rationalize the amount of their donations.


The three-tier indicators (feelings, knowledge skills, behaviors) first let the social welfare staff know the priorities and key points of the project, and then quantify the results. It also allows the sponsor to better understand where the money is going, such as the church’s fundraising, such as the goal It is clear that it is to fund the school start and book expenses of children from poor families, and the faithful often support it; and if it is said that the church’s finances are tight, and many ministries require money and hope to get support from the faithful, then, because The goal is not clear, but the fundraising results are often unsatisfactory. In fact, it is the same in the investment market. If the company can clearly explain where the capital needs to be invested, how the effect will be explained, investors will be more at ease, but if it is to raise funds for general operating purposes, it is naturally daunting, and the same good thing if A bit more expensive, people still believe that the risk is controllable and are willing to support it. On the contrary, uncertainty will make investors wary.


The author understands that for social welfare staff, it is more hard work to measure effectiveness, but being able to speak clearly will make people feel at ease in donating, and in the long run it will be more rational to make more rational decisions about organization development and manpower deployment.

Ted Kwan

Chief Mentor and Chartered Financial Analyst

#Social BenefitMeasurement#SocialImpactMeasurement


Social benefit return on investment


S ocial

R eturn

O n

I nvestment

As the name suggests, Social Return On Investment (SROI) is a method of using money to interpret the benefits produced by social projects. Paradoxically, the positive changes in many societies are inherently elusive and difficult to directly translate into money. For example, if someone says that after a certain disadvantaged group undergoes some kind of intervention, the group's sense of self-esteem increases by 100,000 yuan, it is hard to believe that such a statement will have the slightest convincing power. Is SROI useless? The answer is no. If the project sponsor (government department, commercial organization or family fund) needs to understand the nature of the proposed project in a relatively short period of time, SROI as a simple number allows them to have at least a basic grasp of the benefits of the project; suppose the project sponsor receives For the two proposed project plans, the social benefits of Project A will bring two yuan of social benefits for each dollar of investment, and the social benefits of Project B will bring four yuan of social benefits for each dollar of investment. If both The nature of the projects is similar, so sponsors will naturally prefer the “big reward” project B. Therefore, if we can make good use of SROI, we can increase the chance of sponsors funding support projects. The next question is, how do we use SROI to interpret the elusive positive changes? The answer is that we can try our best to choose some details that can be directly measured by money as performance indicators.


In fact, there is an organization that assists mentally rehabilitated people. In the past three years, it has organized a live library, inviting a group of mentally rehabilitated people to show up and share their experiences of overcoming various difficulties to the public. They use the live library’s sharing activities and The society re-engages, so as to maintain a good mental state, avoid the recurrence of the disease, and save the medical cost caused by the recurrence. The medical cost is originally calculated in currency, so there is no sense of violation of the medical expenditure to be included in the SROI, and it is calculated. SROI naturally has a high reference value.


Samuel Lee


#SocialImpactMeasurement#SocialImpactMeasurement#SocialEfficiencyInvestmentReturn#SROI #hksim #马会丰盛Social efficiency measurement program#JCFullnessSIMCoachingScheme


Monetization of social benefits


要將社會效益金錢化,現行比較完善的做法是先為一些具體的社會效益,如我有恆常參與義工,我對社區有認同感等等,制定一個年度金額。例如對社區有認同感在英國的價值為每年3,753 英鎊。


這個金額是首先去了解對社區有認同感比起沒有認同感的人,在其幸福感的相差是多少? 假設是有認同感的人會高出百分之三的幸福感分數,然後,查一查在幸福感分數中,需要多少收入之提升同樣能夠達致百分之三分的升幅,假設是年收入多出五千英鎊。我們就可以以此收入之提升作為有社區認同感的社會價值,這做法的好處是其一致性,所有的金額都是用人均年收入為基礎去計算,而任何社會效益都歸納為對幸福感之影響。




這樣的三組數據,1) 人均年收入,2) 幸福感分數及3) 社區認同感分數以統計學方式結合,就可計出其金額。有了此數,其應用就比較簡單。


例如有一項目是創造社區認同,可以在項目完結時訪問受眾的社區認同感之分數是多少,例如是4分(在0-10分之中),那麼其社會價值便是 0.4 x 3,753 = 1,501英鎊,再加一條去問受眾認為有多少的認同感是由此項目所帶來的,以0-10分數為本,例如其回答之平均數是4,即只有百分之四十的認同是來自此項目,所以其社會效益是 0.4 x 1,501 = 600 英鎊,再乘以項目之受惠人數,就可計出社會效益之金額。






關志康 (Ted Kwan)


#社會效益量度 #SocialImpactMeasurement #社會效益金錢化 #MonetizationofSoicalImpact #hksim #賽馬會豐盛社會效益量度計劃 #JCFullnessSIMCoachingScheme

Relevance change theory (Theory of Change)


10_適切的改變理論(Theory of Change)





以本地的大學社會創業教育為例,我們常常強調學生透過做有趣的實事來學習創業,於是引用D. Kolb的Experiential Learning Theory作為改變理論。但現在的年青人對由上而下的項目是相當抗拒,要成功誘發年青人積極參與創業活動,項目人員必須擺出一種和參與者平起平坐的姿態以建立良好的關係,從而促進相互了解和溝通。所以,大學社會創業教育的改變理論,既要具備Experiential Learning Theory的元素,也要具備關係對等的元素。這種制定改變理論的方法,在認受性和回應相關社會問題兩方面都能兼顧。


李浩 (Samuel Lee)


#社會效益量度 #SocialImpactMeasurement #改變理論 #Theoryofchange #hksim #賽馬會豐盛社會效益量度計劃 #JCFullnessSIMCoachingScheme


Blind spots of project sponsors








我的朋友希望錢只送到有需要的人手上,但怎樣去找出真正有需要的人呢? 誰人去找他們出來呢? 如果有需要的人就在你眼前出現,為什麼不把錢直接送給他而要找中間人去將錢送出呢? 


在香港,不少很有需要的人都隱藏在社會的角落,不容易去辨識,就算找到,他們的需要是否跟我們想捐助的內容配合呢? 例如他們要的是一個工作機會但我們卻想捐飯盒。要配對得好,中介人不單是左來右送,亦要有判斷能力,或再做合適轉介。商業社會如要將商品送到合適的人手上,可以籠統稱為公司的經常性開支,可佔去百分之十五至二十五的價格,如套入社福場景,每一百元的捐助,可能要花上二十元去找出合適的受助者,只有八十元才能直送手上。中間所要的尋找費用、宣傳、核實都要不少人力物力。所以,筆者認為一社福項目,當中牽涉機構的統籌、匯報、良好管治、招聘,隨時可以用上百分之十五的整體項目費用。有時容許在預算中列清行政費用,反而令到真正放在項目的相關支出一目了然,減低了數字中的水份,令項目的成效更可作出比較。


關志康 (Ted Kwan)


#社會效益量度 #SocialImpactMeasurement #hksim #賽馬會豐盛社會效益量度計劃 #JCFullnessSIMCoachingScheme


Promoting System Transformation—Take Hong Kong University's Sustainable Rural Project as an example 




Nesta 是英國一家推動創新的機構。根據其數年前所發表的研究報告,任何組織若對相關領域有豐富知識,但缺乏制度上的權力,便須採取和他人協作的策略(Collaborative Strategies) 以增加影響力,使當權者感受到轉化系統的迫切性。和他人協作策略主要有四大面向,當中包括建立聯盟(coalitions)、建立溝通機制(communications)、建立可信性和建立人才庫以掌握突然臨到的機會(contingencies)。
















李浩 (Samuel Lee)


#社會效益量度 #SocialImpactMeasurement #hksim #賽馬會豐盛社會效益量度計劃 #JCFullnessSIMCoachingScheme


Four short stories about how to use ``practical research'' thinking to talk to funders and personnel management under the epidemic (1)

農曆年前跟賽馬會豐盛社會效益量度培訓計劃的Samuel相聚,談到實踐研究(practice research)思維,如何協助機構在COVID-19下與資助者溝通和維持同事在新常態服務轉型下的士氣,也分享了幾個小故事。故事是自己和同事的經歷,跟「社會影響」拉不上甚麼大關係,但事後竟得對方邀請,在3月中做了一場線上分享會,希望藉我們四個故事拋磚引玉,刺激大家在新常態下共謀進路。




  1. 「應急式」轉為網上的服務,是否真的有效及值得繼續?

  2. 「以不變應萬變」的服務,是否能對應疫情下的社會狀況與需要?

而第一個故事,就是與資助者討論是否可以把服務轉為網上及長遠轉為網上服務相關。我起的故事標題為「Research-informed practice」,主角是我們兩個專為小學生而設的含抗毒元素健康教育服務項目。




















故事第一個出場的主角,是服務特殊教育需要學生及家長的「星級成長路II」中「家庭樂Fun Fun」親子活動。這個一個多小時的活動,令參與的孩子和父母可以利用不同材料去藝術創作,過程中他們可輕鬆分享自己的創作想法、感受和回憶親子間的樂事,藉此促進親子溝通和相互了解。這活動一直廣受學校歡迎,疫情下也跟我們預約。


事實上,10多間已預約我們合作的學校中,有學校提出能否改以網上進行活動,計劃也在去年年底也進入最後半年倒數,但我們與資助者之間一直膠著。最終我們借鑑實踐研究中的「行動研究」(action research)做法,與資助者達成共識試行數場網上活動,並利用實體活動的評估工具進行成效評估。若具成效,資助者會讓參與學校選擇網上版或實體版,若成效不彰就維持只做實體活動的安排。


  1. 要試多少場次才足夠和合理地反映網上活動成效?及

  2. 如何合理斷定網上版跟實體活動一樣具成效?

最終我們跟資助者協議「三盤兩勝」制。若只得一場,成敗可能是運氣使然:若兩場的話,一場有效一場欠成效也難於有定案;若試行太多場也超過參考的需要。與此同時,因為我們假設網上「家庭樂Fun Fun」跟實體活動一樣會幫到參與的孩子和家長,所以以實體活動的「七成參加者有正面改變」作各項評估指標的成效參照(KPI)。

















黃子瑋 (Keith)

轉載自 HKGoodPost: https://www.hkgoodpost.com/2021/03/22/%e5%9b%9b%e5%80%8b%e5%9c%a8%e7%96%ab%e6%83%85%e4%b8%8b%e5%a6%82%e4%bd%95%e4%bb%a5%e3%80%8c%e5%af%a6%e8%b8%90%e7%a0%94%e7%a9%b6%e3%80%8d%e6%80%9d%e7%b6%ad%e8%88%87%e8%b3%87%e5%8a%a9%e8%80%85%e5%b0%8d/?fbclid=IwAR3Zb5CJqyahGyuJ3ZnvZt-bWL1Os0Pulos6R0C4yIQ5T42IocAXU2GlPOo

#社會效益量度 #SocialImpactMeasurement #hksim #賽馬會豐盛社會效益量度計劃 #JCFullnessSIMCoachingScheme


Four short stories about how to use ``practical research'' thinking to talk to funders and personnel management during the epidemic (2)





在社會衝突及疫情夾擊下,我們具社工資歷的表達藝術治療師餅sir (Terrence)仍成功完成兩個治療小組,但小組在提升組員的自尊感及自我效能感方面的效果卻不似如期,資助者也致電來關心。

筆者跟餅Sir因應上述情況的討論方向,主要是借「實踐研究」思維去思考社會發生的大事有否構成影響服務在推出後才出現的新外在因素(new externalities),及該些因素對服務成效帶來的潛在影響。

這狀況也刺激了筆者對服務成效評估的反思。一直以來,我留意到量性的成效評估設計都是希望以最簡單的假設去進行,所以服務成效主要是跟有否得到服務和接受服務的密度有關,而少有假設「外在因素」對成效的影響。即使有,那些外在因素大都集中於當事人是否曾經或正接受其他機構或單位提供的類此服務支援。很多時可能因為缺乏相關文獻參考、或受評估工具長度限制、甚至是貪方便,評估者會假設服務期間的「外在因素」是維持不變 (ceteris paribus 或holding other factors constant)。


One of the reminders of the epidemic is to review with my colleagues the possible impact of "external factors" on services. Taking this experience as an example, we explored the approach through qualitative narratives to understand and summarize the lives of the service providers and their own situation under the epidemic.


The thinking of "practical research" also reminds us that "external factors" are divided into Deadweight and Attribution. The former will reduce the expected results of the service or even nullify the results, while the latter will promote the results without your input. For example, even if adolescent children You will naturally grow taller without participating in additional exercise classes, so the exploration will consider the possibility of two major factors.


Narrative inquiry also requires us to summarize and analyze data from a preset perspective, otherwise it will be no different from ordinary casual talk. Our cake Sir defined "life in the epidemic" as "economic participation activities", "family life" and "social life" to understand the situation of the team members and came up with the following findings:


  1. The epidemic hits the labor market. If the parties encounter employment challenges during the post-test, the two performance indicators will inevitably fall in the post-test. However, the process has also led us to discover that if the parties are still working as usual under the epidemic, they will have and maintain a high sense of self-esteem and self-efficacy during the pre-test and post-test, so that the positive changes brought about by the group's intervention are not obvious;

  2. Family life pressure and conflicts with family members will affect the person’s sense of self-esteem and self-efficacy;

  3. In terms of social life, group members who value friends and experience themselves in the interaction with friends, because they can’t see friends or reduce their social interactions under restricted gatherings, have hit their sense of self-esteem and self-efficacy.


The above findings give us the direction to understand with funders why the effectiveness of the art therapy group in this issue is not as good as the previous service, and it also stimulates us to think about how to supplement the related service change theory (theory of change) used in the past.


Some people may think that the approach of qualitative narrative inquiry is not enough to be quantitative, methodological and scientific. I suggest that those friends can check the references on Google, and they will find that the approach can actually be scientific and can also provide extremely useful reference and practical knowledge. This is one of the articles that I find interesting to refer to. Even medical service-related research topics will use narrative exploration.


Another thing worth remembering in this story is that at the moment when the face-to-face treatment team was suspended due to the epidemic, Cake Sir seized the time to understand the foreign expression art therapy society’s suggestions to its members, and also began to collect some relevant treatment applications in addiction and addiction. Read the literature research on prevention of relapse with the author. Later, he invited Dr. Lan Jianwen from the Department of Social Work of Hong Kong Baptist University and his team to help further enrich our original theory of group therapy changes.



Through the dialogue and communication between the pie sir and the team, and the larger-scale literature review with the other party, we finally constructed 7 possible effects of art therapy in preventing relapse of drug rehabilitation patients, such as "the inner ability to control one's own impulse" , And these expected results are measured by existing scales with a certain degree of reliability.


In the sharing session, Ted hosted a special question about how the cooperation with the college’s researchers went smoothly. In the cooperation between Cake Sir and HKBU, I have the following observations:


  1. Institutions must be frank and let the college understand their ideas and needs. Take our cooperation this time as an example. We want to enrich the original theory of change, and we also want to more realistically define the effects of the service, such as the generation of "inner balance" and "inner energy." We admit that there are only relatively vague ideas, but these ideas will give researchers further directions;

  2. Provide resources to the college. This time we are giving consultant fees to the university team to support the team members in their literature review, summarization, and sorting work. Labor has a price, so is thinking about work;

  3. Cake Sir is happy to share his work observations with colleagues in the college, and dares to feed back the first draft submitted by the college from the perspective of practical services. It is a new theory of change co-produced by the organization and the college.

  4. The cooperation between social workers and researchers is actually one of the important topics of "practical research." Professor Lars Uggerhøj, one of the author's favorite promoters of "practical research", has a very interesting article suggesting possible approaches. If you are interested, you can learn more about it in Lars' article.


Huang Ziwei (Keith)

Reprinted from HKGoodPost: https://www.hkgoodpost.com/2021/03/29/%e5%9b%9b%e5%80%8b%e5%9c%a8%e7%96%ab%e6%83%85 %e4%b8%8b%e5%a6%82%e4%bd%95%e4%bb%a5%e3%80%8c%e5%af%a6%e8%b8%90%e7%a0%94%e7 %a9%b6%e3%80%8d%e6%80%9d%e7%b6%ad%e8%88%87%e8%b3%87%e5%8a%a9%e8%80%85%e5%b0 %8d-2/




How much is our service worth?


In terms of calculating the social return on investment (SROI), if a human-oriented service project does not involve granting aid to the recipients or assisting them in achieving cost savings, then the project team may consider using Contingent Valuation as the SROI Calculation basis. The conditional evaluation method is derived from economics. The specific method is to invite the relevant person to directly use the amount he/she thinks is appropriate to express his/her opinion on something that does not involve market transactions, for example, if the planning department of a local government wants to Knowing the value of a certain natural landscape to a residential community, the department can interview people living in the community and invite them to express the monetized value of the landscape in their minds.


In the same way, the project team can invite the recipients to express the monetization value of the project in their minds through questionnaires after the project is completed, but the investigator must emphasize that the purpose of the survey is not to charge the recipients, and must guide them to use the project The transformation of affection, cognition, behavior, etc. is used as the basis of the evaluation project.

Ideally, every interviewee can tell the value of monetization. However, in actual operation, the interviewee is often clueless; in this case, if the investigator can provide reference data, it may be easier for the interviewee to answer the monetization value. Recently, this Council has measured social benefits for a non-governmental organization that promotes primary medical services. However, there are no highly similar projects on the market for reference. Therefore, we only provide the fees charged by a nursing home with higher service quality as the interview. Of course, the investigator can further explain the similarities and differences between primary care and nursing homes to the interviewees, so that the interviewees can more accurately estimate the monetization value.

Samuel Lee


#SocialImpactMeasurement#SocialImpactMeasurement#Change Theory#Theoryofchange #hksim #马会丰盛Social efficiency measurement plan#JCFullnessSIMCoachingScheme