| OED Evaluation of the Integrated Framework for Trade-Related Technical Assistance |
|
|
|
| Written by Aldo Caliari, Center Of Concern |
|
OED Evaluation of the Integrated Framework for Trade-Related Technical Assistance
In an earlier report, in 2000, the OED identified the following as shortcomings of the IF program:
As this paper demonstrates, most of these criticisms continue to exist today. 2. Insufficient Funding The IF was criticized as insufficiently financed.[2] As a result, the program remains small relative to DC needs, and a large gap endures between IF means and DC expectations of it.[3] While clearly a problem of itself, such dissonance additionally generates issues regarding ownership/credibility of the program; this concern, however, is examined later in the paper. Conceived by its formulating agencies as a device to mainstream trade, and not as a site for new resources, it was noted that DCs are generally expected to seek investment funds related to the technical assistance provided through the PRSP process, a mechanism that has generally been unfruitful.[4] While funds coming directly from the IF to support projects identified in technical assistance have increased, country needs, as well as demand, continue to far outweigh supply.[5] Relatedly, as regards the Bank's presence in the IF catalyzing non-Bank investment, the program was rated as 'modest';[6] the financing of investments identified by technical assistance, at the level of country operations, was furthermore rated as 'negligible'.[7] In light of this, the feasibility of the Bank's stated long-term goal of transferring funding of the program to donors must be questioned.[8] It was suggested that funding gains could be made by better defining agency roles and improving their coordination,[9] an aspect of the program's governance examined below. Nevertheless, separate from the funding issues related to further assistance, concerns about the financing of the IF's more limited core objectives persist.[10] The program's 'venture capital' funding model was also criticized, with comments that a more rational and informed approach needs to be adopted.[11] As alluded to above, difference of opinion between implementing agencies/developed countries as regards the objectives and the means of the program, and DCs' expectations of it, led to the IF being assessed as lacking sufficient DC ownership.[12] Indeed on the criteria of accountability to DCs, the IF obtained a rating of 'negligible'.[13] In part this stems from the fact that DCs have little in-put in the program's design.[14] More importantly, however, there exists a large gap between the extent of advocacy underpinning IF recommendations and its overall goals, and the level of the program's resources - discussed above - supporting these ends.[15] Such a disparity led to a view that the program lacked credibility.[16] Veritably, it was noted that DCs 'largely see [the] IF as run by and for its six international-agency partners'.[17] Indeed, in contrast to the dissonance between the IF's aims and DC expectations of it, there exists definite congruence between IF objectives and the six organizations involved.[18] It was suggested that without appropriate sector studies being undertaken or complementary investment projects being supported, DCs may regard the IF as 'merely trade reform under a different name'.[19] This opinion was bolstered by the IF's downplay of the more central, underlying trade problems faced by DCs, such as developed country market access and internal supply constraints.[20] It was suggested that reform should include focusing on the policies and practices of developed countries/international agencies which currently inhibit DCs' trade performance, as well as the effect of changes to such policies and practices on DCs.[21] With diminished DC capacity to articulate the program's direction, IF focus on international consensus - a criterion for initial Bank involvement in a sector[22] - is weak.[23] 4. Weak Governance The IF was also criticized for its poor governance, with the need for more businesslike conduct of board meetings and transparency/openness in its operations noted.[24] The necessity for developing agendas in consultation with board members, for specialized subcommittees for specific issues, and for timely issuance of board meeting minutes were all specifically mentioned.[25] Governance issues were at least partly to blame for the lack of feeling of ownership of the IF by DCs, discussed above.[26] IF governance was further criticized on account of the ill-defined nature of the roles of its member partners and governing bodies.[27] The lack of articulation of the specific roles of international organizations, bi-lateral donors and DCs was notorious in this regard.[28] It was noted that this meant the program's objectives - themselves criticized vis- ƒÆ’  -vis coherence and clarity[29] - were less likely to be incorporated into PRSPs, with reduced chance of government and donor support of follow-up activities.[30] Little budget allocation for oversight and no standard terms of reference outlining the responsibilities and accountabilities of Bank staff were also deemed matters of concern.[31] It was suggested, as a whole, that the IF take a more holistic approach as regards its governance.[32] It was noted that the IF operates under a more decentralized model than when first conceived, such reform being adopted in light of a feeling of a lack of ownership by the Bank's regional staff.[33] However, while regional economists are now provided resources for management of DTISs, in order to better mobilize trade-investment resources through Bank- and donor-delivered lending and grants, this has not percolated down to country level.[34] Reform of structures so as to amend this arrangement was suggested.[35] 5. Lack of a Results-Oriented Framework It was noted the lack of a results-based framework hindered the IF in being an effective program.[36] The implicit assumption that program outputs would automatically lead to achievement of objectives was criticized,[37] the expectation that DTISs would of themselves lead to integration in the multilateral trading system and improved export performance being specifically cited in this regard.[38] Assessment of whether intended outcomes would automatically follow or of the steps required for implementation was absent from the program.[39] While DTISs have improved, and a small paradigm shift as a whole appears to be underway,[40] it was found that they still could be more focused and operational towards promoting investment and facilitating policy and institutional reform.[41] DTISs were also generally felt to be insufficiently precise as regards prioritizing and addressing identified weaknesses, and in dealing with external market access problems like agriculture.[42] To summarize, the IF was felt to retain an insufficient focus on trade outcomes, being more concerned with process.[46] While DTISs were described as a 'good beginning', they were deemed not to provide an adequate basis for a country to devise an export strategy.[47] It was felt the IF needed to go beyond identifying deficiencies to actually meeting country needs/demands.[48] It was suggested that establishing concrete country-level indicators and related performance gauges, together with an emphasis on monitoring, would remedy these issues in part.[49] It was stressed that monitoring of results and impacts, and formulation of strategy, should generally occur at the country level,[50] where donor coordination and awareness of the IF is poor.[51] This would also assist in overcoming governance-related problems.[52] 6. Lack of Coordination/Links to Other Programs Adjunct to, but separate from, governance issues was the lack of coordination amongst donors. While the IF has undoubtedly enhanced coordination amongst agencies providing technical assistance,[53] further steps to improve efficiency in this regard were definitely needed.[54] In this regard, the fact that operational procedures of the different agencies continue to differ was cited as notable.[55] As noted above, DCs may actually see the unstated objective of enhancing donor and international agency co-operation as the IF's real goal, rather than its stated aim of mainstreaming trade into country development.[56] Paradoxically then, increased coordination amongst implementing agencies may simultaneously both benefit and injure the program. A related issue was the need for better coordination between authorities administering the IF and those administering aid programs.[57] Indeed, as regards its link to country-specific operations and the financing of related investments, the IF was rated as 'modest but improving'.[58] This was cited as an area where the IF should concentrate its efforts in the future.[59] Likewise, at the country level, donor coordination and awareness of the IF is poor.[60] This partially explains the funding issues dogging the program and calling into question its long term viability;[61] as noted above. Regarding the Bank's presence in the IF as catalyzing non-Bank investment, the program was rated as 'modest'.[62] The lack of synergy between the IF and other related programs, such as the Development Economics Vice Presidency (DEC) was also commented upon as wasteful.[63] This is notable given increased involvement with such programs being an objective of the IF as re-formulated in 2000.[64] The recent engagement of the IF in related projects like JITAP was thus praised and encouraged.[65] 7. Little Value-Add/Effective Impact Perhaps most damning of all, the value-add of the IF vis- ƒÆ’  -vis both the Bank and its clients was questioned.[66] While it was concluded too early to assess whether any value-add was outweighed by the program's high transaction costs, the issue was raised.[67] It was suggested such transaction costs need minimizing, in addition to better resourcing more generally.[68] Indeed, it was commented that the IF could be considered by some as largely ineffective.[70] Elsewhere, it was noted that the program brought 'few and uncertain (documented) impacts'.[71] It was moreover questioned whether the IF even had the right program objectives, or if they were merely formulated in line with available resources and agreed partnership and management arrangements.[72] The IF was criticized as a program that has 'created too many expectations on which it is unable to deliver'.[73] Endnotes [1] IF Report 3, 7. [2] A problem that has dogged the IF since its inception, despite being noted in the earlier OED Report: IF Report ix, xv. [3] GP Report 24, 46, 118, IF Report x-xii, 4, 5. [4] GP Report 24, 46, 76, IF Report xii, 11. [5] GP Report 24, 117, IF Report x, xii, xv. [6] GP Report 240. [7] GP Report 197, IF Report xiv. Elsewhere in the GP Report, the program appears to rate as 'modest' on a very similar criterion: GP Report 42. [8] See GP Report 236-7. [9] IF Report 20. [10] GP Report 24. [11] GP Report 88. Management has accepted this criticism: GP Report 243. [12] GP Report 24, 61, IF Report xvi. [13] GP Report 196-7. [14] See IF Report 23. [15] GP Report 24, 61, IF Report xvi. The IF was rated 'high or substantial' as regards advocacy and supporting national-level policy, institutional and technical reforms, while 'negligible' as regards the financing of country-level investments: GP Report 196-7. [16] GP Report 24. [17] GP Report 61, IF Report xvi. The congruence between IF objectives and those of the six organizations involved should also be noted: see IF Report 21. [18] IF Report 21. [19] IF Report 29. [20] GP Report 24, 61, 75, 85, 117, IF Report xv. Where discussed, the latter is emphasized more than the former: GP Report 46, 117. It is noted that increased public profile of the former issue may pressure developed countries to alter their current policies: IF Report xii. [21] IF Report xiii, 12. [22] See GP Report xxiii. [23] GP Report 27. Indeed, rated as 'modest': GP Report 240. [24] GP Report 59, IF Report 20. As regards the criterion of transparency, the IF rated as 'modest': GP Report 230-1. [25] GP Report 59. [26] GP Report 61. [27] GP Report 65, IF Report 20. As regards the criterion of clarity of roles and responsibilities, the IF rated as 'modest': GP Report 230-1. Governance structure was also highlighted in the 2000 OED Report on the IF: IF Report ix, 19-20. [28] GP Report 65, IF Report xi-xiii, 20. [29] GP Report 214-15. This is a problem that was also noted in the OED's earlier report: IF Report ix. [30] GP Report 65. This, however, is somewhat improving. Trade-facilitation lending operations are also apparently in the pipeline: GP Report 117. [31] GP Report 70. It was further noted that while IF now has a monitoring matrix and requires a focal point in each country, some focal points: 'allocate insufficient time or fail to attend relevant meetings': IF Report x. [32] IF Report xv, 32. [33] IF Report xiv. [34] IF Report xiv. [35] IF Report xiv-xv. [36] GP Report 117, IF Report xv, 9. This problem has dogged the IF since its inception: GP Report 117. As regards the criterion of possessing a structured set of quantitative or qualitative indicators, the IF rated 'negligible': GP Report 214-15. The IF further received a rating of 'modest' as regards the criterion of possessing systematic and regular processes for data collection and management: GP Report 214-15. The IF Secretariat, with its limited resources, decided that adopting a results-based framework would unduly increase its burden, opting instead to focus on 'bigger process' bottlenecks: IF Report x. [37] GP Report 37, 46, IF Report xi. [38] GP Report 37. [39] GP Report 37, IF Report xi. [40] It is reported that some results-based management and evaluation system are being implemented: GP Report 46. [41] GP Report 117, IF Report 12, 26. [42] IF Report 10, 13. [43] IF Report 15. [44] IF Report 13-14. [45] IF Report xi. [46] IF Report xv, 32. [47] IF Report 15. [48] IF Report xvi. [49] IF Report xiii, xv, 32. [50] IF Report xv. [51] IF Report xvi. [52] IF Report 20. [53] IF Report xiii, 18. [54] GP Report 65, IF Report xi-xiii, 20. [55] IF Report 20, 22. [56] IF Report xvi, 11-12, 21. [57] IF Report 19. [58] GP Report 42, IF Report xiv. As regards the Bank's presence catalyzing non-Bank investment, the program was rated as 'modest': GP Report 240. [59] IF Report xii. [60] IF Report xvi. [61] See GP Report 65, 197, 240, IF Report xiv. [62] GP Report 240. [63] GP Report 72. [64] See IF Report 7. [65] IF Report xiii, 16. [66] GP Report 44, 72, IF Report xiv; see also n 2 above. Indeed, on this criterion the IF was rated as 'modest': GP Report 240. [67] IF Report xiii, 20. It was also noted any such calculation might be difficult to assess, owing to the largely intangible nature of many of the benefits surrounding the program: IF Report xiv. [68] IF Report xv. [69] IF Report 25. [70] GP Report 24, IF Report xv. [71] GP Report 49. It was also noted it was too early to know the IF's ultimate impacts on its beneficiaries: GP Report 118. [72] IF Report xv. [73] IF Report xv.Like it? Share it!
|









